if ci_badges.map(&:color).detect { it != "green"} ☝️ let me know, as I may have missed the discord notification.
if ci_badges.map(&:color).all? { it == "green"} 👇️ send money so I can do more of this. FLOSS maintenance is now my full-time job.
👣 How will this project approach the September 2025 hostile takeover of RubyGems? 🚑️
I've summarized my thoughts in this blog post.
Ast::Merge is not typically used directly - instead, use one of the format-specific gems built on top of it.
The *-merge gem family provides intelligent, AST-based merging for various file formats. At the foundation is tree_haver, which provides a unified cross-Ruby parsing API that works seamlessly across MRI, JRuby, and TruffleRuby.
| Gem | Version / CI | Language / Format |
Parser Backend(s) | Description |
|---|---|---|---|---|
| tree_haver | Multi | Supported Backends: MRI C, Rust, FFI, Java, Prism, Psych, Commonmarker, Markly, Citrus, Parslet | Foundation: Cross-Ruby adapter for parsing libraries (like Faraday for HTTP) | |
| ast-merge | Text | internal | Infrastructure: Shared base classes and merge logic for all *-merge gems |
|
| bash-merge | Bash | tree-sitter-bash (via tree_haver) | Smart merge for Bash scripts | |
| commonmarker-merge | Markdown | Commonmarker (via tree_haver) | Smart merge for Markdown (CommonMark via comrak Rust) | |
| dotenv-merge | Dotenv | internal | Smart merge for .env files |
|
| json-merge | JSON | tree-sitter-json (via tree_haver) | Smart merge for JSON files | |
| jsonc-merge | JSONC | tree-sitter-jsonc (via tree_haver) | ||
| markdown-merge | Markdown | Commonmarker / Markly (via tree_haver), Parslet | Foundation: Shared base for Markdown mergers with inner code block merging | |
| markly-merge | Markdown | Markly (via tree_haver) | Smart merge for Markdown (CommonMark via cmark-gfm C) | |
| prism-merge | Ruby | Prism (prism std lib gem) |
Smart merge for Ruby source files | |
| psych-merge | YAML | Psych (psych std lib gem) |
Smart merge for YAML files | |
| rbs-merge | RBS | tree-sitter-rbs (via tree_haver), RBS (rbs std lib gem) |
Smart merge for Ruby type signatures | |
| toml-merge | TOML | Parslet + toml, Citrus + toml-rb, tree-sitter-toml (all via tree_haver) | Smart merge for TOML files |
tree_haver supports multiple parsing backends, but not all backends work on all Ruby platforms:
| Platform 👉️ TreeHaver Backend 👇️ |
MRI | JRuby | TruffleRuby | Notes |
|---|---|---|---|---|
| MRI (ruby_tree_sitter) | ✅ | ❌ | ❌ | C extension, MRI only |
| Rust (tree_stump) | ✅ | ❌ | ❌ | Rust extension via magnus/rb-sys, MRI only |
| FFI (ffi) | ✅ | ✅ | ❌ | TruffleRuby's FFI doesn't support STRUCT_BY_VALUE |
| Java (jtreesitter) | ❌ | ✅ | ❌ | JRuby only, requires grammar JARs |
| Prism (prism) | ✅ | ✅ | ✅ | Ruby parsing, stdlib in Ruby 3.4+ |
| Psych (psych) | ✅ | ✅ | ✅ | YAML parsing, stdlib |
| Citrus (citrus) | ✅ | ✅ | ✅ | Pure Ruby PEG parser, no native dependencies |
| Parslet (parslet) | ✅ | ✅ | ✅ | Pure Ruby PEG parser, no native dependencies |
| Commonmarker (commonmarker) | ✅ | ❌ | ❓ | Rust extension for Markdown (via commonmarker-merge) |
| Markly (markly) | ✅ | ❌ | ❓ | C extension for Markdown (via markly-merge) |
Legend: ✅ = Works, ❌ = Does not work, ❓ = Untested
Why some backends don't work on certain platforms:
- JRuby: Runs on the JVM; cannot load native C/Rust extensions (
.sofiles) - TruffleRuby: Has C API emulation via Sulong/LLVM, but it doesn't expose all MRI internals that native extensions require (e.g.,
RBasic.flags,rb_gc_writebarrier) - FFI on TruffleRuby: TruffleRuby's FFI implementation doesn't support returning structs by value, which tree-sitter's C API requires
Example implementations for the gem templating use case:
| Gem | Purpose | Description |
|---|---|---|
| kettle-dev | Gem Development | Gem templating tool using *-merge gems |
| kettle-jem | Gem Templating | Gem template library with smart merge support |
The *-merge gem family is built on a layered architecture:
tree_haver provides cross-Ruby parsing capabilities:
- Universal Backend Support: Automatically selects the best parsing backend for your Ruby implementation (MRI, JRuby, TruffleRuby)
- 10 Backend Options: MRI C extensions, Rust bindings, FFI, Java (JRuby), language-specific parsers (Prism, Psych, Commonmarker, Markly), and pure Ruby fallback (Citrus)
- Unified API: Write parsing code once, run on any Ruby implementation
- Grammar Discovery: Built-in
GrammarFinderfor platform-aware grammar library discovery - Thread-Safe: Language registry with thread-safe caching
Ast::Merge builds on tree_haver to provide:
- Base Classes:
SmartMergerBase,ConflictResolverBase,MergeResultBase,FreezeNodeBase,FileAlignerBase,PartialTemplateMergerBase,KeyPathPartialTemplateMergerBase, andDiffMapperBase - Shared Modules and helpers:
FileAnalyzable,MergerConfig,DebugLogger,NodeTyping,SectionTyping, andTrailingGroups - Freeze Block Support: Configurable marker patterns for multiple comment syntaxes
- Region Detection:
Ast::Merge::Detector::Base,FencedCodeBlock,YamlFrontmatter,TomlFrontmatter, andDetector::Mergeable - Error Classes:
ParseError,TemplateParseError,DestinationParseError, andPlaceholderCollisionError - RSpec Shared Examples: Test helpers for implementing new merge gems
Some format families justify a shared middle layer above ast-merge.
Current example:
markdown-merge— shared Markdown-family behavior such as parser-neutral Markdown orchestration, link-reference handling, and code-block delegation that should be shared across Markdown parser wrappers without forcing Markdown-specific logic intoast-merge
- Thin wrappers such as
commonmarker-mergeandmarkly-mergeprovide backend-specific defaults on top ofmarkdown-merge - Leaf gems such as
prism-merge,psych-merge,json-merge, andbash-mergeadaptast-mergeto a specific format and parser stack
When deciding where new behavior belongs, use this routing rule:
| If the behavior is shared by... | Put it in... |
|---|---|
| multiple unrelated formats | ast-merge |
| multiple Markdown parser wrappers | markdown-merge |
| one wrapper's backend defaults only | that wrapper gem |
| one format/parser combination only | that leaf *-merge gem |
This keeps ast-merge focused on cross-format substrate while preserving room for intentional family-specialized layers.
These are the first shared capabilities to check before building a bespoke helper:
| Capability | Shared owner | Reach for it when you need... |
|---|---|---|
Ast::Merge::Comment::* |
ast-merge |
normalized comment nodes, attachments, tracked comment regions, or comment-aware merge behavior |
Ast::Merge::Layout::* |
ast-merge |
blank-line ownership, shared gap control, or edit-safe layout preservation |
Ast::Merge::StructuralEdit::* |
ast-merge |
contiguous structural replace/remove/rehome primitives that preserve untouched source and can carry comment/layout boundary metadata |
Ast::Merge::TrailingGroups::* |
ast-merge |
position-aware insertion of template-only nodes |
Ast::Merge::FileAlignerBase |
ast-merge |
signature-based alignment pipelines with shared pairwise matching, optional fuzzy refinement, and overridable entry payload / alias / sort hooks |
Ast::Merge::NodeTyping / SectionTyping |
ast-merge |
type-aware preferences or section-aware merge policy |
Ast::Merge::PartialTemplateMergerBase |
ast-merge |
section-scoped or region-scoped merges driven by structural boundaries |
Ast::Merge::KeyPathPartialTemplateMergerBase |
ast-merge |
partial merges that target hierarchical key paths in structured documents |
Ast::Merge::Recipe::{Preset, Config, Runner} |
ast-merge |
reusable recipe-backed merge policies, normalized partial-target contracts (anchor/boundary or key_path), and parser-family dispatch |
markdown-merge shared layer |
markdown-merge |
behavior shared across Markdown parsers but not appropriate for the cross-format substrate |
If a prospective solution fits one of these rows, prefer extending that shared layer before introducing regex- or line-oriented merge logic.
For recipe-driven partial merges, the stock contract in ast-merge is now: exactly one normalized partial target per recipe, either a navigable structural target (anchor + optional boundary) or a hierarchical key_path target. That targeting contract is shared substrate; the parser-specific merger that fulfills it still belongs in the relevant leaf gem or family layer.
ast-merge deliberately does not treat every post-merge cleanup as shared substrate.
Use this routing rule:
ast-mergeowns structural splice invariants and syntax-agnostic output guarantees- family layers such as
markdown-mergeown family-specific normalization - leaf
*-mergegems own format/parser-local emitter polish
In practice, ast-merge is the right place for things like:
- preserving structural ownership while recombining content
- guaranteeing stable section replacement / insertion boundaries
- preserving comment and layout attachments across edits
- exposing normalized recipe contracts and partial-target routing
It is not automatically the right place for things like:
- Markdown link-reference rehydration
- Markdown whitespace canon or other serializer-specific cleanup
- parser-local quoting, delimiter, or formatter preferences
If a normalization rule depends on one syntax family's rendering semantics, keep it in that family layer or leaf emitter unless it clearly proves reusable across unrelated formats.
These are the highest-value places to look before adding new bespoke merge logic:
| Repo / layer | Hotspot | Prefer to reuse or extend... |
|---|---|---|
ast-merge |
parser-family partial-template routing, structural edit primitives, shared capability discoverability | ast-merge substrate |
markdown-merge |
boundary between Markdown-family behavior and cross-format substrate | markdown-merge first, ast-merge only for proven cross-format needs |
kettle-jem |
README/CHANGELOG section parsing, Gemfile/Gemspec/Appraisals post-merge surgery | recipes, shared partial merges, and shared AST edit primitives |
| hash-comment family repos | repeated comment_tracker.rb implementations |
Ast::Merge::Comment::* plus shared tracker bases |
| JSONC / C-style comment flows | repeated line/block comment tracking logic | shared C-style tracker primitives |
If your new work lands in one of these rows, assume there is probably a shared solution or a missing shared primitive worth extracting.
ast-merge is the authoring foundation for the *-merge family, and the implementation guide is organized across these references:
- Canonical guide:
BUILD_A_MERGE_GEM.md - Per-gem architecture reference:
MERGE_APPROACH.md - Shared blank-line/layout model:
lib/ast/merge/layout/README.md - RSpec shared examples and registration:
lib/ast/merge/rspec/README.md - Reference implementation:
lib/ast/merge/text/README.md
If you are creating a new merge gem, the usual path is:
- implement a
FileAnalysisthat exposes stable mergeable statements and signatures - choose either an inline
SmartMergeror a delegatedConflictResolver - use cursor-based positional matching for duplicate signatures
- adopt
Ast::Merge::TrailingGroupsfor position-aware template-only insertion - add comments, freeze markers, recursive merge, regions, or partial-template support only as the format requires
- wire the gem into the shared RSpec support and
MergeGemRegistry
For the current AST-over-regex rollout, the following ast-merge seams are the intended stable downstream extension points for new or existing *-merge gems:
- authoring bases:
SmartMergerBase,ConflictResolverBase,MergeResultBase,FileAlignerBase,PartialTemplateMergerBase,KeyPathPartialTemplateMergerBase,DiffMapperBase - shared capability families:
Comment::*,Layout::*,StructuralEdit::*,TrailingGroups::*,NodeTyping,SectionTyping - recipe/preset surface:
Recipe::{Preset, Config, Runner}and the normalized partial-target contract (anchor/boundaryorkey_path) - test/registration surface: shared RSpec support and
MergeGemRegistry
What is not frozen as a downstream contract:
- parser-local leaf behavior (
prism-merge,psych-merge,markdown-merge, etc.) - family-layer behavior that intentionally lives above
ast-merge - private helper methods inside concrete leaf gems that are not documented here or in
BUILD_A_MERGE_GEM.md
If a future change needs to reshape one of the stable seams above, it should be treated as a contract change and called out explicitly in release notes rather than happening implicitly during another migration.
| Base Class | Purpose | Key Methods to Implement |
|---|---|---|
SmartMergerBase |
Main merge orchestration | analysis_class, perform_merge |
ConflictResolverBase |
Resolve node conflicts | resolve_batch or resolve_node_pair |
MergeResultBase |
Track merge results | to_s, format-specific output |
FileAlignerBase |
Signature-based file/declaration alignment | template_entry_key, dest_entry_key, add_signature_aliases, template_only_entry_context |
PartialTemplateMergerBase |
Section-scoped merges | create_analysis, create_smart_merger, find_section_end, node_to_text |
KeyPathPartialTemplateMergerBase |
Key-path partial merges | create_analysis, child_entries_for, create_smart_merger, parse_content_value, dump_content_value, deep_merge_content_value |
DiffMapperBase |
Unified diff parsing + AST path mapping foundation | create_analysis, map_hunk_to_paths, build_path_for_node |
MatchRefinerBase |
Fuzzy node matching | similarity |
ContentMatchRefiner |
Text content fuzzy matching | Ready to use |
FileAnalyzable |
File parsing/analysis | compute_node_signature |
DiffMapperBase, FileAlignerBase, PartialTemplateMergerBase, and KeyPathPartialTemplateMergerBase are opt-in authoring primitives. Format-specific gems provide the path-mapping, alignment payload shapes, section-rendering logic, structured child traversal, serialization, and any syntax-aware output cleanup that makes those workflows concrete for a particular syntax.
Ast::Merge::ContentMatchRefiner is a built-in match refiner for fuzzy text content matching using Levenshtein distance. Unlike signature-based matching which requires exact content hashes, this refiner allows matching nodes with similar (but not identical) content.
# Basic usage - match nodes with 70% similarity
refiner = Ast::Merge::ContentMatchRefiner.new(threshold: 0.7)
# Only match specific node types
refiner = Ast::Merge::ContentMatchRefiner.new(
threshold: 0.6,
node_types: [:paragraph, :heading],
)
# Custom weights for scoring
refiner = Ast::Merge::ContentMatchRefiner.new(
threshold: 0.7,
weights: {
content: 0.8, # Levenshtein similarity (default: 0.7)
length: 0.1, # Length similarity (default: 0.15)
position: 0.1, # Position in document (default: 0.15)
},
)
# Custom content extraction
refiner = Ast::Merge::ContentMatchRefiner.new(
threshold: 0.7,
content_extractor: ->(node) { node.text_content.downcase.strip },
)
# Use with a merger
merger = MyFormat::SmartMerger.new(
template,
destination,
preference: :template,
match_refiner: refiner,
)This is particularly useful for:
- Paragraphs with minor edits (typos, rewording)
- Headings with slight changes
- Comments with updated text
- Any text-based node that may have been slightly modified
The Ast::Merge module is organized into several namespaces, each with detailed documentation:
BUILD_A_MERGE_GEM.md— canonical guide for implementing a new*-mergefamily gemMERGE_APPROACH.md— merge-strategy comparison and per-gem examples
| Namespace | Purpose | Documentation |
|---|---|---|
Ast::Merge::Detector |
Region detection and merging | lib/ast/merge/detector/README.md |
Ast::Merge::Recipe |
YAML-based merge recipes | lib/ast/merge/recipe/README.md |
Ast::Merge::Comment |
Comment parsing and representation | lib/ast/merge/comment/README.md |
Ast::Merge::Layout |
Shared blank-line layout ownership | lib/ast/merge/layout/README.md |
Ast::Merge::Text |
Plain text AST parsing | lib/ast/merge/text/README.md |
Ast::Merge::RSpec |
Shared RSpec examples | lib/ast/merge/rspec/README.md |
Key Classes by Namespace:
- Detector:
Region,Base,Mergeable,FencedCodeBlock,YamlFrontmatter,TomlFrontmatter - Recipe:
Preset,Config,Runner,ScriptLoader - Comment:
Line,Block,Empty,Parser,Style - Layout:
Gap,Attachment,Augmenter - Text:
SmartMerger,FileAnalysis,LineNode,WordNode,Section,LineSectionSplitter - RSpec: Shared examples and dependency tags for testing
*-mergeimplementations
| Tokens to Remember | |
|---|---|
| Works with JRuby | |
| Works with Truffle Ruby | |
| Works with MRI Ruby 3 | |
| Support & Community | |
| Source | |
| Documentation | |
| Compliance | |
| Style | |
| Maintainer 🎖️ | |
... 💖 |
Compatible with MRI Ruby 3.2.0+, and concordant releases of JRuby, and TruffleRuby.
| 🚚 Amazing test matrix was brought to you by | 🔎 appraisal2 🔎 and the color 💚 green 💚 |
|---|---|
| 👟 Check it out! | ✨ github.com/appraisal-rb/appraisal2 ✨ |
Find this repo on federated forges (Coming soon!)
| Federated DVCS Repository | Status | Issues | PRs | Wiki | CI | Discussions |
|---|---|---|---|---|---|---|
| 🧪 kettle-rb/ast-merge on GitLab | The Truth | 💚 | 💚 | 💚 | 🐭 Tiny Matrix | ➖ |
| 🧊 kettle-rb/ast-merge on CodeBerg | An Ethical Mirror (Donate) | 💚 | 💚 | ➖ | ⭕️ No Matrix | ➖ |
| 🐙 kettle-rb/ast-merge on GitHub | Another Mirror | 💚 | 💚 | 💚 | 💯 Full Matrix | 💚 |
| 🎮️ Discord Server | Let's | talk | about | this | library! |
Available as part of the Tidelift Subscription.
Need enterprise-level guarantees?
The maintainers of this and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source packages you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact packages you use.
- 💡Subscribe for support guarantees covering all your FLOSS dependencies
- 💡Tidelift is part of Sonar
- 💡Tidelift pays maintainers to maintain the software you depend on!
📊@Pointy Haired Boss: An enterprise support subscription is "never gonna let you down", and supports open source maintainers Alternatively:
Install the gem and add to the application's Gemfile by executing:
bundle add ast-mergeIf bundler is not being used to manage dependencies, install the gem by executing:
gem install ast-mergeFor Medium or High Security Installations
This gem is cryptographically signed, and has verifiable SHA-256 and SHA-512 checksums by stone_checksums. Be sure the gem you install hasn’t been tampered with by following the instructions below.
Add my public key (if you haven’t already, expires 2045-04-29) as a trusted certificate:
gem cert --add <(curl -Ls https://raw.github.com/galtzo-floss/certs/main/pboling.pem)You only need to do that once. Then proceed to install with:
gem install ast-merge -P HighSecurityThe HighSecurity trust profile will verify signed gems, and not allow the installation of unsigned dependencies.
If you want to up your security game full-time:
bundle config set --global trust-policy MediumSecurityMediumSecurity instead of HighSecurity is necessary if not all the gems you use are signed.
NOTE: Be prepared to track down certs for signed gems and add them the same way you added mine.
ast-merge provides base classes and shared interfaces for building format-specific merge tools.
Each implementation (like prism-merge, psych-merge, etc.) has its own SmartMerger with format-specific configuration.
All SmartMerger implementations share these configuration options:
merger = SomeFormat::Merge::SmartMerger.new(
template,
destination,
# When conflicts occur, prefer template or destination values
preference: :template, # or :destination (default), or a Hash for per-node-type
# Add nodes that only exist in template (Boolean or callable filter)
add_template_only_nodes: true, # default: false, or ->(node, entry) { ... }
# Custom node type handling
node_typing: {}, # optional, for per-node-type preference
)Control which source wins when both files have the same structural element:
:template- Template values replace destination values:destination(default) - Destination values are preserved- Hash - Per-node-type preference (see Advanced Configuration)
Control whether to add nodes that only exist in the template:
true- Add all template-only nodesfalse(default) - Skip template-only nodes- Callable - Filter which template-only nodes to add
When you need fine-grained control over which template-only nodes are added, pass a callable (Proc/Lambda) that receives (node, entry) and returns truthy to add or falsey to skip:
# Only add nodes with gem_family signatures
merger = SomeFormat::Merge::SmartMerger.new(
template,
destination,
add_template_only_nodes: ->(node, entry) {
sig = entry[:signature]
sig.is_a?(Array) && sig.first == :gem_family
},
)
# Only add link definitions that match a pattern
merger = Markly::Merge::SmartMerger.new(
template,
destination,
add_template_only_nodes: ->(node, entry) {
entry[:template_node].type == :link_definition &&
entry[:signature]&.last&.include?("gem")
},
)The entry hash contains:
:template_node- The node being considered for addition:signature- The node's signature (Array or other value):template_index- Index in the template statements:dest_index- Alwaysnilfor template-only nodes
# spec/spec_helper.rb
require "ast/merge/rspec/shared_examples"
# spec/my_format/merge/freeze_node_spec.rb
RSpec.describe(MyFormat::Merge::FreezeNode) do
it_behaves_like "Ast::Merge::FreezeNode" do
let(:freeze_node_class) { described_class }
let(:default_pattern_type) { :hash_comment }
let(:build_freeze_node) do
lambda { |start_line:, end_line:, **opts|
# Build a freeze node for your format
}
end
end
end"Ast::Merge::FreezeNode"- Tests for FreezeNode implementations"Ast::Merge::MergeResult"- Tests for MergeResult implementations"Ast::Merge::DebugLogger"- Tests for DebugLogger implementations"Ast::Merge::FileAnalysisBase"- Tests for FileAnalysis implementations"Ast::Merge::MergerConfig"- Tests for SmartMerger implementations
Freeze blocks are special comment-delimited regions in your files that tell the merge tool to preserve content exactly as-is, preventing any changes from the template. This is useful for hand-edited customizations you never want overwritten.
A freeze block consists of:
- A start marker comment (e.g.,
# mytoken:freeze) - The protected content
- An end marker comment (e.g.,
# mytoken:unfreeze)
# In a Ruby file with prism-merge:
class MyApp
# prism-merge:freeze
# Custom configuration that should never be overwritten
CUSTOM_SETTING = "my-value"
# prism-merge:unfreeze
VERSION = "1.0.0" # This can be updated by template
endThe FreezeNode class represents these protected regions internally.
Each format-specific merge gem (like prism-merge, psych-merge, etc.) configures its own
freeze token (the token in token:freeze), which defaults to the gem name (e.g., prism-merge).
Different file formats use different comment syntaxes. The merge tools detect freeze markers using the appropriate pattern for each format:
| Pattern Type | Start Marker | End Marker | Languages |
|---|---|---|---|
:hash_comment |
# token:freeze |
# token:unfreeze |
Ruby, Python, YAML, Bash, Shell |
:html_comment |
<!-- token:freeze --> |
<!-- token:unfreeze --> |
HTML, XML, Markdown |
:c_style_line |
// token:freeze |
// token:unfreeze |
C (C99+), C++, JavaScript, TypeScript, Java, C#, Go, Rust, Swift, Kotlin, PHP, JSONC |
:c_style_block |
/* token:freeze */ |
/* token:unfreeze */ |
C, C++, JavaScript, TypeScript, Java, C#, Go, Rust, Swift, Kotlin, PHP, CSS |
| 📍 NOTE |
|---|
CSS only supports block comments (/* */), not line comments. |
| JSON does not support comments; use JSONC for JSON with comments. |
The node_typing option allows you to customize merge behavior on a per-node-type basis.
When combined with a Hash-based preference, you can specify different merge
preferences for different types of nodes (e.g., prefer template for linter configs but destination for everything else).
-
Define a
node_typing: A Hash mapping node type symbols to callables that receive a node and return either:- The original node (no special handling)
- A wrapped node with a
merge_typeattribute (viaAst::Merge::NodeTyping::Wrapper)
-
Use a Hash-based preference: Instead of a simple
:destinationor:templateSymbol, pass a Hash with::defaultkey for the fallback preference- Custom keys matching the
merge_typevalues from yournode_typing
# Example: Prefer template for lint gem configs, destination for everything else
node_typing = {
call_node: ->(node) {
if node.name == :gem && node.arguments&.arguments&.first&.unescaped&.match?(/rubocop|standard|reek/)
Ast::Merge::NodeTyping::Wrapper.new(node, :lint_gem)
else
node
end
},
}
merger = Prism::Merge::SmartMerger.new(
template_content,
dest_content,
node_typing: node_typing,
preference: {
default: :destination,
lint_gem: :template,
},
)The Ast::Merge::NodeTyping::Wrapper class wraps an AST node and adds a merge_type attribute.
It delegates all method calls to the wrapped node, so it can be used transparently in place of the original node.
# Wrap a node with a custom merge_type
wrapped = Ast::Merge::NodeTyping::Wrapper.new(original_node, :special_config)
wrapped.merge_type # => :special_config
wrapped.class # => Ast::Merge::NodeTyping::Wrapper
wrapped.location # => delegates to original_node.location# Process a node through the node_typing configuration
processed = Ast::Merge::NodeTyping.process(node, node_typing_config)
# Check if a node has been wrapped with a merge_type
Ast::Merge::NodeTyping.typed_node?(node) # => true/false
# Get the merge_type from a wrapped node (or nil)
Ast::Merge::NodeTyping.merge_type_for(node) # => Symbol or nil
# Unwrap a node type wrapper to get the original
Ast::Merge::NodeTyping.unwrap(wrapped_node) # => original_nodeEven without node_typing, you can use a Hash-based preference to set a default
and document your intention for future per-type customization:
# Simple Hash preference (functionally equivalent to preference: :destination)
merger = MyMerger.new(
template_content,
dest_content,
preference: {default: :destination},
)The MergerConfig class provides factory methods that support all options:
# Create config preferring destination
config = Ast::Merge::MergerConfig.destination_wins(
freeze_token: "my-freeze",
signature_generator: my_generator,
node_typing: my_typing,
)
# Create config preferring template
config = Ast::Merge::MergerConfig.template_wins(
freeze_token: "my-freeze",
signature_generator: my_generator,
node_typing: my_typing,
)ast-merge includes a YAML-based recipe system for defining portable, distributable merge configurations. Recipes allow any project to ship merge knowledge as data — a YAML file (and optionally small companion Ruby scripts) — that consumers can load and execute without writing merge instrumentation.
The recipe system provides two levels of configuration:
Ast::Merge::Recipe::Preset— Merge configuration only (preference, signature generator, node typing, freeze token). Use when you have your own template/destination handling and just need the merge settings.Ast::Merge::Recipe::Config— Full recipe extending Preset with template file, target glob patterns, injection point configuration, and when_missing behavior.
Recipe::Preset is parser-agnostic and can be passed to any format-specific SmartMerger. Recipe::Runner is narrower: in the stock ast-merge gem it currently drives parser-specific partial-template mergers for Markdown via :markly / :commonmarker, for Ruby via :prism, and for YAML via :psych.
A simple preset recipe is just a YAML file — no companion folder or Ruby scripts required:
name: my_config
description: Merge YAML config files with destination preference
parser: psych
merge:
preference: destination
add_missing: true
freeze_token: my-projectLoad and use it:
preset = Ast::Merge::Recipe::Preset.load("path/to/my_config.yml")
merger = Psych::Merge::SmartMerger.new(template, destination, **preset.to_h)
result = merger.mergeA full recipe adds template, targets, and partial-target configuration. In ast-merge, the built-in runner uses this flow for section updates in parsers that expose navigable anchor/boundary targets (for example Markdown and Ruby):
name: gem_family_section
description: Update gem family section in README files
# Template file (relative to recipe file)
template: GEM_FAMILY_SECTION.md
# Target files (supports globs)
targets:
- README.md
- vendor/*/README.md
# Where to inject/replace content
injection:
anchor:
type: heading
text: "/Gem Family/"
position: replace
boundary:
type: heading
same_or_shallower: true
# Merge settings
merge:
preference: template
add_missing: true
# When anchor is not found in a target
when_missing: skipExecute it:
recipe = Ast::Merge::Recipe::Config.load("path/to/gem_family_section.yml")
runner = Ast::Merge::Recipe::Runner.new(recipe, dry_run: true, parser: :markly)
results = runner.run
puts runner.summary
# => { total: 10, updated: 5, unchanged: 3, skipped: 2 }YAML partial recipes use injection.key_path instead of anchor/boundary targeting, for example:
name: rubocop_excludes
template: rubocop_excludes.yml
targets:
- .rubocop.yml
injection:
key_path:
- AllCops
- Exclude
merge:
preference: destination
add_missing: true
when_missing: addFor other formats, the durable interface in this gem is still Preset#to_h; callers pass that option hash to the format-specific merger they are using.
Or via CLI:
bin/ast-merge-recipe path/to/gem_family_section.yml --dry-run --parser=markly| Field | Required | Description |
|---|---|---|
name |
Yes | Recipe identifier |
description |
No | Human-readable description |
parser |
No | Parser identifier stored on the preset/config. Preset defaults to prism; Recipe::Runner takes its parser separately and currently supports markly, commonmarker, and psych. |
merge.preference |
No | :template or :destination. Default: :template |
merge.add_missing |
No | true, false, or path to a Ruby script returning a callable filter. Default: true |
merge.signature_generator |
No | Path to companion Ruby script (relative to recipe folder) |
merge.node_typing |
No | Hash mapping node class names to companion Ruby script paths |
merge.match_refiner |
No | Path to companion Ruby script for match refinement |
merge.normalize_whitespace |
No | true to collapse excessive blank lines in markdown recipe flows |
merge.rehydrate_link_references |
No | true to convert inline links to reference style in markdown recipe flows |
freeze_token |
No | Token for freeze block preservation (e.g., "my-project") |
| Field | Required | Description |
|---|---|---|
template |
Yes | Path to template file (relative to recipe file or absolute) |
targets |
No | Array of glob patterns for target files. Default: ["*.md"] |
injection.anchor.type |
No | Node type to match (e.g., heading, paragraph) |
injection.anchor.text |
No | Text pattern — string for exact match, /regex/ for pattern |
injection.anchor.level |
No | Heading level (for heading anchors) |
injection.position |
No | replace, before, after, first_child, last_child. Default: replace |
injection.boundary.type |
No | Node type that marks the end of the section |
injection.boundary.same_or_shallower |
No | true to end at next same-level-or-higher heading |
injection.key_path |
No | Array path for parser-specific partial targets such as YAML keys (for example ['AllCops', 'Exclude']) |
when_missing |
No | skip, append, prepend, or parser-specific options such as YAML add. Default: skip |
When a recipe needs custom signature matching or node categorization beyond the defaults, it can reference Ruby scripts in an optional companion folder. The folder name must match the recipe name (without .yml):
my - project /
recipes /
my_format.yml # The recipe
my_format/ # Optional companion folder
signature_generator.rb # Returns a lambda for node matching
typing /
call_node.rb # Returns a lambda for node categorization
Each script must return a callable (the last expression is the return value):
# signature_generator.rb
lambda do |node|
return node unless node.is_a?(Prism::CallNode)
case node.name
when :gem
first_arg = node.arguments&.arguments&.first
[:gem, first_arg.unescaped] if first_arg.is_a?(Prism::StringNode)
when :source
[:source]
else
node
end
endScripts are loaded on demand via Ast::Merge::Recipe::ScriptLoader and cached for the lifetime of the preset.
When matching nodes by text content (e.g., heading anchors), the .text method returns plain text without formatting:
| Markdown Source | .text Returns |
|---|---|
### The `*-merge` Gem Family |
The *-merge Gem Family |
**Bold text** |
Bold text |
[link text](url) |
link text |
Write patterns that match the plain text:
- Wrong:
text: "/`\*-merge` Gem Family/" - Correct:
text: "/\\*-merge Gem Family/"
Recipes are designed to be portable. A project can ship recipes in its gem or repository:
- Minimal recipes (YAML only) need no companion folder — consumers only need
ast-merge - Advanced recipes (YAML + scripts) ship the companion folder alongside the YAML
- Consumers load recipes with
Ast::Merge::Recipe::Preset.load(path)orConfig.load(path)— no dependency onkettle-jemor any specific tool - The kettle-jem gem provides a collection of built-in recipes for common file types (Gemfile, gemspec, Rakefile, Appraisals, Markdown)
See lib/ast/merge/recipe/README.md for additional details and examples.
While kettle-rb tools are free software and will always be, the project would benefit immensely from some funding. Raising a monthly budget of... "dollars" would make the project more sustainable.
We welcome both individual and corporate sponsors! We also offer a wide array of funding channels to account for your preferences (although currently Open Collective is our preferred funding platform).
If you're working in a company that's making significant use of kettle-rb tools we'd appreciate it if you suggest to your company to become a kettle-rb sponsor.
You can support the development of kettle-rb tools via GitHub Sponsors, Liberapay, PayPal, Open Collective and Tidelift.
| 📍 NOTE |
|---|
| If doing a sponsorship in the form of donation is problematic for your company from an accounting standpoint, we'd recommend the use of Tidelift, where you can get a support-like subscription instead. |
Support us with a monthly donation and help us continue our activities. [Become a backer]
NOTE: kettle-readme-backers updates this list every day, automatically.
No backers yet. Be the first!
Become a sponsor and get your logo on our README on GitHub with a link to your site. [Become a sponsor]
NOTE: kettle-readme-backers updates this list every day, automatically.
No sponsors yet. Be the first!
I’m driven by a passion to foster a thriving open-source community – a space where people can tackle complex problems, no matter how small. Revitalizing libraries that have fallen into disrepair, and building new libraries focused on solving real-world challenges, are my passions. I was recently affected by layoffs, and the tech jobs market is unwelcoming. I’m reaching out here because your support would significantly aid my efforts to provide for my family, and my farm (11 🐔 chickens, 2 🐶 dogs, 3 🐰 rabbits, 8 🐈 cats).
If you work at a company that uses my work, please encourage them to support me as a corporate sponsor. My work on gems you use might show up in bundle fund.
I’m developing a new library, floss_funding, designed to empower open-source developers like myself to get paid for the work we do, in a sustainable way. Please give it a look.
Floss-Funding.dev: 👉️ No network calls. 👉️ No tracking. 👉️ No oversight. 👉️ Minimal crypto hashing. 💡 Easily disabled nags
See SECURITY.md.
If you need some ideas of where to help, you could work on adding more code coverage, or if it is already 💯 (see below) check reek, issues, or PRs, or use the gem and think about how it could be better.
We so if you make changes, remember to update it.
See CONTRIBUTING.md for more detailed instructions.
See CONTRIBUTING.md.
Everyone interacting with this project's codebases, issue trackers,
chat rooms and mailing lists agrees to follow the .
Made with contributors-img.
Also see GitLab Contributors: https://gitlab.com/kettle-rb/ast-merge/-/graphs/main
This Library adheres to .
Violations of this scheme should be reported as bugs.
Specifically, if a minor or patch version is released that breaks backward compatibility,
a new version should be immediately released that restores compatibility.
Breaking changes to the public API will only be introduced with new major versions.
dropping support for a platform is both obviously and objectively a breaking change
—Jordan Harband (@ljharb, maintainer of SemVer) in SemVer issue 716
I understand that policy doesn't work universally ("exceptions to every rule!"), but it is the policy here. As such, in many cases it is good to specify a dependency on this library using the Pessimistic Version Constraint with two digits of precision.
For example:
spec.add_dependency("ast-merge", "~> 4.0", ">= 4.0.0") # ruby >= 3.2.0📌 Is "Platform Support" part of the public API? More details inside.
SemVer should, IMO, but doesn't explicitly, say that dropping support for specific Platforms is a breaking change to an API, and for that reason the bike shedding is endless.
To get a better understanding of how SemVer is intended to work over a project's lifetime, read this article from the creator of SemVer:
See CHANGELOG.md for a list of releases.
The gem is available as open source under the terms of
the MIT License .
See LICENSE.txt for the official Copyright Notice.
-
Copyright (c) 2025-2026 Peter H. Boling, of
Galtzo.com
, and ast-merge contributors.
Maintainers have teeth and need to pay their dentists. After getting laid off in an RIF in March, and encountering difficulty finding a new one, I began spending most of my time building open source tools. I'm hoping to be able to pay for my kids' health insurance this month, so if you value the work I am doing, I need your support. Please consider sponsoring me or the project.
To join the community or get help 👇️ Join the Discord.
To say "thanks!" ☝️ Join the Discord or 👇️ send money.
Thanks for RTFM.