Unify Pipelines and Firestore classic in CDN and g3 builds #9323

MarkDuckworth · 2025-10-15T18:34:26Z

For CDN and G3 builds, we will output two bundles:

firebase-firestore.js - includes only Firestore classic API surface
firebase-firestore-pipelines.js - includes both the Firestore classic and Firestore Pipelines API surface. The Pipelines API surface is in a namespace called (pipelines).

* Change (BETA) annotation to (Public Preview) * format * Minor bump

* Create Node CJS and ESM bundles * Add changeset * Run formatter * register version with node

* Fix vectorvalue docs * Use @link vector * Fix vector link with code tag

* Re-enable redirect tests * Fix lint

* WIP * Introduce VertexAIModel base class, add documentation, and respond to other comments * Generate devsite docs * revert dataconnect change * formatting * WIP * Introduce VertexAIModel base class, add documentation, and respond to other comments * Generate devsite docs * revert dataconnect change * formatting * Fix ImagenRequestConfig comment * Improve tests * Formatting * Add ImagenGenerationResponse * Formatting * Update to match API changes * fixes * format * Update API reports * add changeset * update * format * Update API reports * remove public docs * Nest imageFormat in outputOptions * remove unecessary console.log * Log warning if compressionQuality outside of range * format * Imagen Documentation (#8776) * Revert "remove public docs" This reverts commit f095563. * update docs * update docs * format * minor fixes * format * mark all APIs beta instead of public * review fixes * format * Replace (BETA) with (Public Preview) in docs * fix links * another pass * format * review fixes * Cleanup * update changeset --------- Co-authored-by: dlarocque <[email protected]>

* Add support for token-based usage metrics. Token measurement is broken down by modaliy, with separate counters for image, audio, etc. Tests are in version 6.*, so this change also includes bumping update_responses.sh * Use right name for unspecified enum * Update API reports * Make promptTokensDetails an array * Update API reports * Add missing documentation * Add changeset entry * Fix formatting errors * Update API reports * Add missing refdoc * Update API reports * Use correct formatting for Modality documentation. * Update API reports * Update docs * Update packages/vertexai/src/types/enums.ts Co-authored-by: rachelsaunders <[email protected]> * Update md files * Revert changes to api-extractor.json --------- Co-authored-by: rachelsaunders <[email protected]>

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

Bumps [cross-spawn](https://github.com/moxystudio/node-cross-spawn) from 7.0.3 to 7.0.6. - [Changelog](https://github.com/moxystudio/node-cross-spawn/blob/master/CHANGELOG.md) - [Commits](moxystudio/node-cross-spawn@v7.0.3...v7.0.6) --- updated-dependencies: - dependency-name: cross-spawn dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This reverts commit 117279e.

Adds a `postinstall` step to `@firebase/util` which hardcodes autoinit defaults into `@firebase/util/dist/postinstall.(m)js` for both CJS and ESM variants [go/firestack-autoinit](http://goto.google.com/firestack-autoinit). Hardcoding is important since environment variable substitution doesn't dive into a developer's `node_modules` folder. This gives us a framework agnostic way to inject configuration and is a more robust solution than the _experimental_ autoinit methods provided by Web Frameworks [go/firebase-api-client-autoinit](https://goto.google.com/firebase-api-client-autoinit). Once this lands, we'll backport to Hosting and Functions and aim to deprecate the other autoinit methods.

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

Release 11.4.0

… of v1beta (#8820) * update API requests to point to v1 instead of v1beta * update changelog

…ensRequest` (#8827)

Modify the retry mechanism to stop when remaining tries is less than or equal to zero, improving the robustness of the retry handling. Fixes #8813

…pipelines

* fix golden files test * update responses version --------- Co-authored-by: David Motsonashvili <[email protected]>

… cdn.ts to packages/firebase/firestore/pipelines

…iceParams (#9314)

…wser unit testing.

dlarocque · 2025-10-22T13:23:03Z

packages/firestore/rollup.config.js

-      })
+      }),
+
+      declareModuleReplacePlugin()


It's not obvious why this plugin is necessary. Can you add comments explaining the problem this solves?

dlarocque · 2025-10-22T13:24:09Z

packages/firestore/rollup.config.js

+  // The regex we created earlier
+  const moduleToReplace =
+    /declare module '\.\/\S+' \{\s+interface Firestore \{\s+pipeline\(\): PipelineSource<Pipeline>;\s+}\s*}/gm;
+
+  // What to replace it with (an empty string to remove it)


These comments seem out of date. Can you update them?

dlarocque · 2025-10-22T13:25:23Z

packages/firestore/rollup.config.js

 ];

+// TODO - update the implementation to match all content in the declare module block.
+function declareModuleReplacePlugin() {


All our custom rollup plugins exist in scripts/build. Can you move this plugin to a new file in that directory?

dlarocque · 2025-10-22T13:28:42Z

packages/firestore/src/core/firestore_client.ts

    public asyncQueue: AsyncQueue,
-    private databaseInfo: DatabaseInfo,
+    /**
+     * @internal


I don't think @internal is necessary here, since FirestoreClient is not a public API.

* dist/firestore/src/global_index.d.ts now includes pipelines in namespace 'pipelines' * Update global.ts * Custom replacer plugin to remove declare module block from global.d.ts * Update CDN and g3 builds of Firestore to include Pipelines in the firebase-firestore.js file * Updated CDN bundles so that firebase-firestore.js is not modified, but firebase-firestore-pipelines.js contains both classic and pipelines APIs. * Fix regression in _internalPipelineToExecutePipelineRequestProto * Fixing missing paths in package.json * Fix binary size script * Add support for index.cdn.ts files in packages/firebase. Then added a cdn.ts to packages/firebase/firestore/pipelines * Rename grpc_connection.node.test.ts, so the file is filtered from browser unit testing.

* clean up exports and imports * Fix implementation of Query to Pipeline for isNan, isNotNan, isNull, and isNotNull changes in the backend * fix tests to accomodate for backend changes to multiple sort stages * another test that the console usage will perform runtime validation of user data * formatting * Copy the latest pipelines tests into lite api pipelines tests. Fix a few minor bugs in the lite pipeline implementation * Remove special handling of null and nan in query to pipeline * remove function expresssions isNan, isNull, isNotNan, isNotNull, and error * Renamed len function to length, with a fix to the prune-dts script * lastest API review md files * fixed title is not null test

…pipelines

…globals

dlarocque and others added 30 commits February 13, 2025 13:45

Change API Documenter (BETA) annotation to (Public Preview) (#8789)

b92592d

* Change (BETA) annotation to (Public Preview) * format * Minor bump

Merge main into release

fa5f8da

Create VertexAI Node CJS and ESM bundles (#8728)

884cbd7

* Create Node CJS and ESM bundles * Add changeset * Run formatter * register version with node

Catch errors in debug token exchange logic (#8792)

f681482

Throw error if mock response file not found (#8739)

84dfeca

Fix vectorvalue docs (#8453)

604133f

* Fix vectorvalue docs * Use @link vector * Fix vector link with code tag

Re-enable auth redirect tests (#8803)

c3266f8

* Re-enable redirect tests * Fix lint

Add Vertex and DataConnect E2E smoke tests (#8805)

1daf8b4

Update dev script dependency @changesets/types to v6 (#8806)

dcfb3da

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

Merge main into release

6670d9c

Revert "Bump cross-spawn from 7.0.3 to 7.0.6 in /e2e (#8645)" (#8811)

2d74e5b

This reverts commit 117279e.

Merge main into release

eb8e4aa

Added non-null properties to database.ThenableReference (#8800)

113c965

Version Packages (#8794)

2eee61a

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

Merge branch 'release'

a24a76a

Release 11.4.0

DataConnect: Update requests to point to v1 backend endpoints instead…

43d6b67

… of v1beta (#8820) * update API requests to point to v1 instead of v1beta * update changelog

Remove auto-commit API report workflow (#8808)

7ae4824

Add missing BlockReason and FinishReason enum values (#8741)

058afa2

Convert enum comments to JSDoc comments (#8742)

42cea48

Add systemInstruction, tools, and generationConfig to `CountTok…

25985ac

…ensRequest` (#8827)

Update yarn.lock in e2e (#8831)

33acc6e

Fix transport service retry logic condition (Fixes #8813) (#8814)

5611175

Modify the retry mechanism to stop when remaining tries is less than or equal to zero, improving the robustness of the retry handling. Fixes #8813

Give check-changeset job pull request write permissions (#8833)

51465ce

Fix: sort strings in UTF-8 encoded byte order with lazy encoding (#8787)

feb2c9d

Merge branch 'main' of github.com:firebase/firebase-js-sdk into feat/…

09508e9

…pipelines

fix golden files test (#8843)

a512bc6

* fix golden files test * update responses version --------- Co-authored-by: David Motsonashvili <[email protected]>

MarkDuckworth added 3 commits October 16, 2025 16:17

Fix regression in _internalPipelineToExecutePipelineRequestProto

a78b761

Fixing missing paths in package.json

cdfc931

Fix binary size script

54a17c6

MarkDuckworth changed the title ~~Unify Pipelines and Firestore classic for G3 import~~ Unify Pipelines and Firestore classic in CDN and g3 builds Oct 17, 2025

MarkDuckworth and others added 8 commits October 17, 2025 15:43

Add support for index.cdn.ts files in packages/firebase. Then added a…

81698f9

… cdn.ts to packages/firebase/firestore/pipelines

send api key to DBE requests (#9331)

adba599

send api key to DBE requests (#9331)

6251400

Fix logic for merging default onDeviceParams with user-provided onDev…

44d9891

…iceParams (#9314)

feat(auth): export beta tagged symbols to public typings (#9313)

91c218d

feat(ai): Add LiveSession realtime APIs (#9291)

22e0a1a

Rename grpc_connection.node.test.ts, so the file is filtered from bro…

637027a

…wser unit testing.

test(ai): Update mock responses to v15 (#9328)

8209266

dlarocque reviewed Oct 22, 2025

View reviewed changes

MarkDuckworth and others added 8 commits October 22, 2025 14:41

feat(ai): Add Live API transcriptions (#9330)

bc5a7c4

Throw on duplicate alias (#9343)

07ca9c6

test(ai): Fix node tests (#9350)

6e0e303

Add support for sending the API key for web channel streams (#9354)

319a396

Merge branch 'main' of github.com:firebase/firebase-js-sdk into feat/…

0aca735

…pipelines

Merge branch 'feat/pipelines' into markduckworth/g3-import-firestore-…

5623923

…globals

MarkDuckworth requested review from a team, NhienLam, Xiaoshouzi-gh, lisajian, mansisampat, pashanka and sam-gc as code owners October 29, 2025 16:14

fixes

3f8d12e

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Unify Pipelines and Firestore classic in CDN and g3 builds #9323

Unify Pipelines and Firestore classic in CDN and g3 builds #9323

Uh oh!

MarkDuckworth commented Oct 15, 2025 •

edited

Loading

Uh oh!

dlarocque Oct 22, 2025

Uh oh!

dlarocque Oct 22, 2025

Uh oh!

dlarocque Oct 22, 2025

Uh oh!

dlarocque Oct 22, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

27 participants

Unify Pipelines and Firestore classic in CDN and g3 builds #9323

Are you sure you want to change the base?

Unify Pipelines and Firestore classic in CDN and g3 builds #9323

Uh oh!

Conversation

MarkDuckworth commented Oct 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dlarocque Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

dlarocque Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

dlarocque Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

dlarocque Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

27 participants

MarkDuckworth commented Oct 15, 2025 •

edited

Loading