Skip to content
This repository was archived by the owner on Oct 19, 2023. It is now read-only.
This repository was archived by the owner on Oct 19, 2023. It is now read-only.

response times out using the push to talk example #461

Open
@electronicsuk

Description

@electronicsuk

running the push to talk example. It appears to working up until playing back the response.
I get a message DEBUG:root:ConverseResponse: audio_data (1600 bytes) then it freezes for about a minute or so then times out.

I have tested the sound configuration using aplay and arecord. They both work as expected. I am running this using a docker container running debian bullseye. The container is hosted by BalenaOs on a raspberry pi 1.2B. I have a fibre over copper internet connection so there's plenty of bandwidth.


Press Enter to send a new request...
INFO:root:Recording audio request.
DEBUG:root:ConverseRequest: config {
  audio_in_config {
    encoding: LINEAR16
    sample_rate_hertz: 16000
  }
  audio_out_config {
    encoding: LINEAR16
    sample_rate_hertz: 16000
    volume_percentage: 50
  }
}

DEBUG:root:ConverseRequest: audio_in (6400 bytes)
WARNING:root:SoundDeviceStream read overflow (3200, 6400)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: event_type: END_OF_UTTERANCE

INFO:root:End of audio request detected
DEBUG:root:ConverseResponse: result {
  spoken_request_text: "what is the weather like"
}

INFO:root:Transcript of user request: "what is the weather like".
INFO:root:Playing assistant response.
DEBUG:root:ConverseResponse: result {
  conversation_state: "\n,C#FOv2::65d288e6-0000-2991-9a3e-089e08285770\022\366\001Kj93OFRSMXhIcC1MMDhBQ0otYlpnTFg1NE43SzdkbXBodzRQNU15UkN0UXdJQUFJQ3pBTUx2bEJWVnVRQUFBQUE4qc-gpgZ6VwoUCAESEDAwMDAwMDY3YTMwNDY0MjgSP3c4VFIxeEhwLUwwOEFDSi1iWmdMWDU0TjdLN2RtcGh3NFA1TXlSQ3RRd0lBQUlDekFNTHZsQlZWdVFBQUFBQYoBFRITCO6PmfjxuYADFT3XAgcdOy0Lyw"
  microphone_mode: CLOSE_MICROPHONE
}

DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)

^TTraceback (most recent call last):
  File "/env/bin/googlesamples-assistant-pushtotalk", line 8, in <module>
    sys.exit(main())
  File "/env/lib/python3.9/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/env/lib/python3.9/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/env/lib/python3.9/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 317, in main
    continue_conversation = assistant.converse()
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 289, in wrapped_f
    return self(f, *args, **kw)
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 379, in __call__
    do = self.iter(retry_state=retry_state)
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 314, in iter
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 382, in __call__
    result = fn(*args, **kwargs)
  File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 109, in converse
    for resp in self.assistant.Converse(iter_converse_requests(),
  File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 475, in __next__
    return self._next()
  File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 864, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
        status = StatusCode.DEADLINE_EXCEEDED
        details = "Deadline Exceeded"
        debug_error_string = "UNKNOWN:Error received from peer ipv4:142.250.179.234:443 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-07-31T21:32:13.336953588+00:00"}"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions