Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PG-1013 Added build comparison table, moved features from index to comparison, created Beta2 release notes #280

Merged
merged 9 commits into from
Dec 26, 2024

Conversation

nastena1606
Copy link
Collaborator

…mpaison

Copy link

github-actions bot commented Sep 16, 2024

Performance test results:
Normal queries: 9266
TDE queries: 8540
Percentage: 92%
CSV entries: 1010312 pp-2019.csv
Sequential scan read times

HEAP: 1100.391
TDE: 1321.890 (120%)
TDE_BASIC: 1321.890 (156%)

@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 7cfa16f to ec4d32d Compare September 16, 2024 16:16
@nastena1606 nastena1606 added the documentation Improvements or additions to documentation label Sep 18, 2024
documentation/docs/features.md Outdated Show resolved Hide resolved
documentation/docs/features.md Outdated Show resolved Hide resolved
documentation/docs/features.md Outdated Show resolved Hide resolved
documentation/docs/features.md Outdated Show resolved Hide resolved
documentation/docs/features.md Outdated Show resolved Hide resolved
@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 71207a9 to e78b293 Compare September 24, 2024 13:43
@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from e78b293 to 2818555 Compare October 8, 2024 11:03
@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 2818555 to 48e4970 Compare December 4, 2024 13:56
@nastena1606 nastena1606 marked this pull request as ready for review December 4, 2024 13:57
@nastena1606 nastena1606 requested a review from dutow December 4, 2024 13:58
| Table encryption: <br> - data tables, <br> - TOAST tables <br> - temporary tables created during the database operation.<br><br> Metadata of those tables is not encrypted. | Table encryption: <br> - data tables, <br> - TOAST tables <br> - temporary tables created during the database operation.<br> - Index data for encrypted tables<br><br> Metadata of those tables is not encrypted. |
| Write-Ahead Log (WAL) encryption of data in encrypted tables | Write-Ahead Log (WAL) encryption of data for encrypted and non-encrypted tables |
| Multi-tenancy support| Multi-tenancy support |
| | Global principal key management |
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd skip "Global principal key management" in this table - it's a necessity for the full WAL encryption rather than a feature.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated


| PostgreSQL Community version | Percona Server for PostgreSQL version <br> |
|----------------------|-------------------------------|
| Table encryption: <br> - data tables, <br> - TOAST tables <br> - temporary tables created during the database operation.<br><br> Metadata of those tables is not encrypted. | Table encryption: <br> - data tables, <br> - TOAST tables <br> - temporary tables created during the database operation.<br> - Index data for encrypted tables<br><br> Metadata of those tables is not encrypted. |
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd stress somehow "Index data for encrypted tables" (bold text or else) because this is the main reason we started this gig but currently, it's visually concealed among other things in the table

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point. Updated, moved to the top in the list

documentation/docs/release-notes/release-notes.md Outdated Show resolved Hide resolved
* Improved memory usage of `tde_heap_basic `during sequential reads
* Improved `tde_heap_basic` for select statements
* Added encryption support for (some) command line utilities
* JSON data is now handled with internal postgres JSON parser instead of jsonc
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the same as "Keyring configuration now uses common JSON API. This simplifies code handling and enables frontend tools like pg_waldump to read the code thus improving debugging."

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed

@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 0ba043d to 377dc27 Compare December 5, 2024 15:23
@nastena1606 nastena1606 changed the title PG-1013 Added build comparison table, moved features from index to comparison PG-1013 Added build comparison table, moved features from index to comparison, created Beta2 release notes Dec 20, 2024
Copy link

@shahidullah79 shahidullah79 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed the location of internal TDE files: instead of the database directory, now all files are stored in$PGDATA/tde``

It is $PGDATA/pg_tde instead of $PGDATA/tde

@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 65b9da2 to cd6a181 Compare December 26, 2024 14:04

* Added the `tde_heap` access method with which you can now enable index encryption for encrypted tables and global WAL data encryption. To use this access method, you must install Percona Server for PostgreSQL. Check the [installation guide](../install.md)
* Added event triggers to identify index creation operations on encrypted tables and store those in a custom storage
* Exposed Storage Manager API and added the usage of Initialization vector (IV) in it.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sentence doesn't make sense here - the storage manager api is exposed by postgres, not pg_tde.

@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from f10efea to 25f67bb Compare December 26, 2024 15:51
@nastena1606 nastena1606 force-pushed the PG-1013-DOC-pg_tde-for-PG17 branch from 25f67bb to cbade1e Compare December 26, 2024 16:10
@nastena1606 nastena1606 merged commit d978282 into main Dec 26, 2024
11 checks passed
@nastena1606 nastena1606 deleted the PG-1013-DOC-pg_tde-for-PG17 branch December 26, 2024 16:14
Copy link

@shahidullah79 shahidullah79 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants