Does streaming work in Cloud Functions v2?

[dosstx]

Does Firebase Cloud Functions 2nd gen support streams?

For some reason, using Nuxt's /api/audio.ts route works, however, when using a Firebase Cloud Function (v2) instead of Nuxt's route, it will fail.

Here is the Firebase Cloud Function code:

import 'dotenv/config'
import { onRequest } from 'firebase-functions/v2/https'

export const generateTextToSpeech = onRequest(
  { cors: true },
  async (request, response) => {
    try {
      const { text } = request.body

      const xiApiKey = process.env.XI_API_KEY

      // Make an external API request
      const apiResponse = await fetch(
        'https://api.elevenlabs.io/v1/text-to-speech/EXAVITQu4vr4xnSDxMaL/stream?optimize_streaming_latency=3',
        {
          method: 'POST',
          headers: {
            accept: 'audio/mpeg',
            'Content-Type': 'application/json',
            'xi-api-key': xiApiKey
          },
          body: JSON.stringify({
            text: 'hello world',
            // text: text,
            model_id: 'eleven_turbo_v2',
            voice_settings: {
              stability: 0.5,
              similarity_boost: 0.75,
              style: 0,
              use_speaker_boost: false
            }
          })
        }
      )
      response.setHeader('Content-Type', 'audio/mpeg')
      response.status(200).send(apiResponse)
    } catch (error) {
      console.error('Error:', error)
      response.status(500).send('An error occurred')
    }
  }
)

That does not work.

This DOES work:

export default defineEventHandler(async (event) => {
  const { text } = await readBody(event)
  const response = await $fetch(
    'https://api.elevenlabs.io/v1/text-to-speech/EXAVITQu4vr4xnSDxMaL/stream?optimize_streaming_latency=3',
    {
      method: 'POST',
      responseType: 'stream',
      headers: {
        accept: 'audio/mpeg',
        'Content-Type': 'application/json',
        'xi-api-key': 'XXXX'
      },
      body: {
        text: 'hello world',
        // text: text,
        model_id: 'eleven_turbo_v2',
        voice_settings: {
          stability: 0.5,
          similarity_boost: 0.75,
          style: 0,
          use_speaker_boost: false
        }
      }
    }
  )
  setResponseHeader(event, 'Content-Type', 'audio/mpeg')
  return response
})

Anyone got any ideas why?

[dosstx]

OK so it looks like Streaming is not supported on Firebase Cloud Functions (nor 2nd Gen). Since it works on Nuxt server routes, is there a way to use Nuxt's server routes on Firebase Hosting?

[posva]

I'm not sure about streaming in Cloud Functions but you need to use a Nuxt defineEVentHandler(). Nitro will then wrap that with Firebase Cloud function onRequest() for you. That's why you see it fail

[dosstx]

I had no idea you could do that. Could you provide a example? This could change my thinking on how to use Firebase and Nuxt.

[isamu]

Yes, supported.

• Using Functions v2 (Cloud Run)
• Implemented on http server with https.onRequest (express etc.)
• Hit the Functions endpoint directly instead of via Firebase Hosting (hosting does buffering)

example code

https://zenn.dev/singularity/articles/firebase-stream