Skip to content

feat(rs): python udf deprecation scaffolding #563

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 77 commits into
base: main
Choose a base branch
from
Draft

feat(rs): python udf deprecation scaffolding #563

wants to merge 77 commits into from

Conversation

@vdelacruzb
Copy link
Contributor

@vdelacruzb vdelacruzb commented Oct 8, 2025 •
edited
Loading

Description

Shortcut

Also including:

  • Integrate lambda deployment in AT CI CD [sc-509837]
  • Migrate all the existing Redshift Python [sc-509838]
  • Generate installable lambda packages [sc-509836]

Now:

  • The environment is really cleaned in case of error in deployment of tests.
  • RS_PREFIX has been simplified as lambda names must be shorter.
  • Updated processing fixtures as we are now using a newer version of scipy.

Type of change

  • Fix
  • Feature
  • Refactor
  • Tests
  • Documentation

Acceptance

Please describe how to validate the feature or fix

  1. go to X
  2. test Y
  3. assert Z

Basic checklist

  • Good PR name
  • Shortcut link
  • Just one issue per PR
  • GitHub labels
  • Proper status & reviewers
  • Tests
  • Documentation

@vdelacruzb
add gateway base
9fb75cc
@vdelacruzb
remove extra documents
1d2d5ec
@vdelacruzb
remove python version specific code
613e2e4
@vdelacruzb
support multiple login methods
7fcde20
@vdelacruzb
apply some naming conventions to roles
4d67624
@vdelacruzb
cleaning unused code
141ca04
@vdelacruzb
more files cleaning
1add4fb
@vdelacruzb
update schema creation
327d1a3
@vdelacruzb
rename category to module
2e0a5e5
@vdelacruzb
fix naming inconsistencies
fdf4a7f
@vdelacruzb
lint
b60d626
@vdelacruzb
add RS_ROLES creating automatted
90d6d76
@vdelacruzb
split environments
e637f7c
@vdelacruzb
add sql linter
d43e2da
@vdelacruzb
update docs
49f8b40
@vdelacruzb
avoid ask schema prefix if prod
e6f23a8
@vdelacruzb
remove sqlfluff
d8def5a
@vdelacruzb
fix packager
65dffed
@vdelacruzb
update makefile to not use slqfluff
a93453a
@vdelacruzb
only include required files into package
8600404
@vdelacruzb
major refactor
7dfaf76
@vdelacruzb
remove cross account deployment
b01bef3
@vdelacruzb
update installer instructions order
966213e
@vdelacruzb
big refactor to integrate in the AT
391e854
@vdelacruzb
improve remove
b2a3e21
@vdelacruzb
ensure full schema dropping after test
109689d
@vdelacruzb
simplify package readme
dc74579
@vdelacruzb vdelacruzb changed the title feat(rs): python udf deprecation feat(rs): python udf deprecation scaffolding Oct 13, 2025
@vdelacruzb
remove RS_BUCKET appearances
363174b
@vdelacruzb
add constructors and allow libs in different files
e390a94
@vdelacruzb
add some more instructions to the installer
dec4d5a
@vdelacruzb
allow filtered modules when creating packages
be87add
@vdelacruzb
respect clustering dir structure
a610490
@vdelacruzb
rename RS_LAMBDA_EXECUTION_ROLE_ARN to RS_LAMBDA_EXECUTION_ROLE
b5dbf9b
@vdelacruzb
add placekey
c77a33a
@vdelacruzb
simplify tests
5141d2a
@vdelacruzb
allow sharing deps
c5a1a95
@vdelacruzb
fix deployment and make tests to stop on fail
5638437
@vdelacruzb
remove placekey module from clouds
10764e3
@vdelacruzb
add processing modules and automatic requirements builder tool
3eb7a2a
@vdelacruzb
fix warning in clustering
bacb0d3
@vdelacruzb
add random
1f9d758
@vdelacruzb
allow better filtering when testing
8fe6c4b
@vdelacruzb
add s2 module
1795b31
@vdelacruzb
run both test and integration
5e615ce
@vdelacruzb
some file renaming
05f42ef
@vdelacruzb
add transformations module and custom short lambda names
73ec95a
@vdelacruzb
add quadkey module
9617992
@vdelacruzb
improve progress bars and allow lambda functions only deploy
7045852
@vdelacruzb
add quadbin and fix issues with float precision
38a252e
@vdelacruzb
shorten yml lambda prefix
70b6e54
@vdelacruzb
update requirements
bf73541
@vdelacruzb
improve make clean
f7c5a38
@vdelacruzb
add make build to simplify testing and creating shared libs
a2832a1
@vdelacruzb
improve requirements building
d7360dd
@vdelacruzb
add claude.md
8845cb6
@vdelacruzb
fix build functions
2b211f2
@vdelacruzb
when make from the root, run both unit and integration tests
458119d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vdelacruzb