You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Review notebooks and increase the parameterization. Follow overview of the NB made by Sreedhar ( #862 ).
This task most likely will be break in more tasks:
investigate if there a point where it could use better the parametrization of the NBs
Example: DDL table definition could be done in separate file.
2)Add the log library to the notebooks.
2.1 Investigate and define how the logs will be stored for this repo and which libraries we should use for this purpose. LIke will be using python telemetry using Open Telemetry or something different/
2.2 Implement the changes in the NBs.
Evaluate if any performance improvements/techniques can be applied.
If necessary, alter the documentation accordingly.
The text was updated successfully, but these errors were encountered:
@LiliamLeme
For your review/refrence, here is current implementation #862 . These use multiple ways of parameterization: %%configure, notebook parameters tag and an external config file application.cfg which uses Python's configparser module to read it.
Review notebooks and increase the parameterization. Follow overview of the NB made by Sreedhar ( #862 ).
This task most likely will be break in more tasks:
Example: DDL table definition could be done in separate file.
2)Add the log library to the notebooks.
2.1 Investigate and define how the logs will be stored for this repo and which libraries we should use for this purpose. LIke will be using python telemetry using Open Telemetry or something different/
2.2 Implement the changes in the NBs.
Evaluate if any performance improvements/techniques can be applied.
If necessary, alter the documentation accordingly.
The text was updated successfully, but these errors were encountered: