Skip to content
yhay81Public

About

Open huge CSV and Parquet files like a spreadsheet. Local-first, MIT. Browser demo, VS Code, CLI, React, MCP Apps and Jupyter.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

9 stars

Watchers

0 watching

Forks

Repository files navigation

vastgrid

npm PyPI VS Code Marketplace CI License: MIT

Open huge CSV and Parquet files like a spreadsheet. Keep your data on your computer.

vastgrid lets you scroll, sort, filter, group and edit large tables with familiar spreadsheet controls. Use it in your browser, VS Code or terminal, or embed the same canvas grid in React, an MCP App or Jupyter. It also reads TSV, JSON Lines, Excel files and DuckDB databases. Free and MIT licensed.

Try 1,000,000 rows — no install · Open your file · Documentation · 日本語

Useful for your next data task? Star vastgrid on GitHub to find it again.

A Parquet file of 100,000,000 rows sorted by price in vastgrid-cli, with a selection and its sum in the status bar

  • Built for large files. Rows are read a block at a time as you scroll, and Parquet files are read in place, also over HTTP Range requests. In the M2 Pro benchmark, DuckDB returned the first sorted rows of a 100-million-row Parquet file in 953 ms; the remaining view took another 3 seconds to build. Cells are drawn on a canvas, and scrolling renders no React.
  • A spreadsheet's way of working. Excel's keys and selections, sorting, filters, conditions, search and find, groups, pivots and totals, formulas, formats, copy, cut, paste and fill.
  • Edits you can trust. Typed input is checked against the column's type, writes are checked for conflicts and can be undone, and saving a CSV or TSV file rewrites only the edited fields and keeps every other byte. A file that changes on disk is followed, and is never saved over. Values that cannot survive a save, including empty strings in CSV and TSV, are refused with the edits kept.
  • One state, typed commands. What the grid shows is a document (the view and its columns) and a session (where the person is), controlled or not. Every change is a command that a toolbar, a host or an AI agent can dispatch.
  • Engines you choose. vastgrid-js in memory, in the page or a Web Worker; vastgrid-duckdb on Node.js; or your own, through a small set of messages.
  • Nine languages (English, Japanese, Chinese in simplified and traditional characters, Korean, Spanish, Brazilian Portuguese, French and German), each its own import (vastgrid/locales/ja); light and dark themes through CSS variables, ARIA grid semantics and full keyboard operation.

Try it in a minute

  1. Open the million-row sample. No account, install or upload.
  2. Open the unit_price column menu (▾), then choose Sort descending.
  3. Select a range of prices to see its sum, or press Ctrl+End / ⌘+End to reach the last row.

The sample runs in your browser's memory engine. The 100-million-row benchmark uses DuckDB on the computer; it is a different workload. For files that exceed browser memory, use the CLI or VS Code:

npx vastgrid-cli sales.parquet

Requires Node.js 22.18 or later. Replace sales.parquet with your file's path. Choose how to open a large file or explore the 200,000-row demo for editing and grouping.

Where to use it

Where How Engine
A React app npm install vastgrid vastgrid-js (quick start) in memory, a worker, or a server
The browser vastgrid.yhay81.com/open/: drop a file; it stays in the browser vastgrid-js in a Web Worker
The command line npx vastgrid-cli sales.parquet DuckDB on this computer
VS Code the extension vastgrid (yhay81.vastgrid-vscode) DuckDB in the extension
An AI chat the MCP server vastgrid-mcp with its MCP App DuckDB in the MCP server
A Jupyter notebook pip install vastgrid, then vastgrid.show(df) DuckDB in the kernel

Where vastgrid opens files compares them: formats, editing, saving and exporting.

Quick start

npm install vastgrid vastgrid-js
import { DataGrid, localTransport } from "vastgrid";
import "vastgrid/styles.css";
import { memoryEngine } from "vastgrid-js";

const transport = localTransport(
  memoryEngine({
    tables: {
      orders: {
        columns: [
          { name: "id", type: "integer" },
          { name: "customer", type: "string" },
          { name: "price", type: "decimal", precision: 10, scale: 2 },
          { name: "ordered", type: "date" },
        ],
        rows: [
          [1, "Acme", "12.50", "2026-01-31"],
          [2, "Globex", "8.00", "2026-02-01"],
        ],
        editable: true,
      },
    },
  }),
);

export function Orders() {
  return <DataGrid transport={transport} table="orders" style={{ height: 480 }} />;
}

For files larger than the page should hold, run the memory engine in a Web Worker, or the DuckDB engine on a server. The guides cover state, editing and saving, formulas, grouping, exporting, theming and your own engine.

The DuckDB engine reads CSV with comma separators and standard double quotes. For other separators or an explicit header, pass open={{ delimiter: ";", headerRow: 1 }} to the grid; headerRow: 0 means no header. By default, the CLI and MCP server keep DuckDB's temporary data in a private folder for the current user. See the engine's reading options.

Packages

Package Contents
vastgrid The React grid: DataGrid, GridProvider and the hooks; vastgrid/core (the store and the transports, without React), vastgrid/server, vastgrid/locales/<tag> (the texts of each language), vastgrid/styles.css.
vastgrid-js The memory engine, for the browser and Node.js: rows of typed JSON, Arrow, CSV, TSV, JSON Lines, Excel and Parquet (also over HTTP).
vastgrid-duckdb The DuckDB engine for Node.js: files of any size and the tables of DuckDB databases, writing cells, saving CSV and TSV, following files, exports; an HTTP handler.
vastgrid-spec The specification as code: types, plan checking, commands, message schemas, the conformance corpus.
vastgrid-sql Plans as DuckDB SQL.
vastgrid-cli npx vastgrid-cli <file>: a file in a grid in the browser, read by DuckDB on this computer.
vastgrid-mcp An MCP server with an MCP App.
vastgrid-vscode The VS Code extension, on the Visual Studio Marketplace and Open VSX.
vastgrid (Python) The Jupyter widget, on PyPI.

The npm packages are released together at one version. vastgrid needs React 19.3 or later (an optional peer dependency: servers use vastgrid/core without React) and a browser with CSS light-dark(): Chrome and Edge 123, Firefox 120, Safari 17.5 or later. The engines need Node.js 22.18 or later; DuckDB runs on Linux (x64, arm64; glibc and musl), macOS (x64, arm64) and Windows (x64, arm64).

Performance

On an Apple M2 Pro. The grid on a million rows in the memory engine shows its first rows 36–49 ms after mounting and drops no frame while scrolling at 60 Hz, with no React commit. The DuckDB engine sorts a 100-million-row Parquet file (1.38 GB) with its first rows ready in 953 ms, and reads a sorted 10-million-row CSV file 256 rows at a time in 4 ms. Performance has every measure and how to repeat them.

Documentation

Contributing

pnpm install
pnpm run build     # every package, the CLI's page, the MCP App and the extension
pnpm test          # the unit tests, on the sources (Vitest)
pnpm run dev       # examples/files: the grid on the DuckDB engine, at http://127.0.0.1:5182

CONTRIBUTING.md has the checks and the guidelines for a change, and SECURITY.md how to report a vulnerability.

License

MIT

About

Open huge CSV and Parquet files like a spreadsheet. Local-first, MIT. Browser demo, VS Code, CLI, React, MCP Apps and Jupyter.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

9 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages