Skip to content

Commit 5cd973e

Browse files
ikxplainlucas-aixplainthiago-aixplainmikelam-us-aixplainThiago Castro Ferreira
authored
Merge to prod. (#175)
* Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <[email protected]> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner functional tests (#112) * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mikelam-us-aixplain <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mikelam-us-aixplain <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Add new LLMs finetuner models (mistral and solar) (#128) * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mikelam-us-aixplain <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Merge to test (#135) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mikelam-us-aixplain <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update FineTune unit and functional tests (#136) * Merge dev to test (#137) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <[email protected]> * Update FineTune unit and functional tests (#136) --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mikelam-us-aixplain <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <[email protected]> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <[email protected]> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <[email protected]> * Updating Signed-off-by: mikelam-us-aixplain <[email protected]> * Updated CLI Signed-off-by: mikelam-us <[email protected]> * Adding CLI Signed-off-by: mikelam-us-aixplain <[email protected]> * Corrected request error Signed-off-by: mikelam-us-aixplain <[email protected]> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding status Signed-off-by: mikelam-us-aixplain <[email protected]> * Simplifying status Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <[email protected]> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <[email protected]> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding tests Signed-off-by: mikelam-us-aixplain <[email protected]> * Fixing hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding hf token Signed-off-by: mikelam-us-aixplain <[email protected]> * Correcting first test Signed-off-by: mikelam-us-aixplain <[email protected]> * Testing Signed-off-by: mikelam-us-aixplain <[email protected]> * Adding config Signed-off-by: mikelam-us-aixplain <[email protected]> * Added user doc Signed-off-by: mikelam-us-aixplain <[email protected]> * Added gated model test Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> * Adding HF token Signed-off-by: mikelam-us-aixplain <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> --------- Signed-off-by: mikelam-us-aixplain <[email protected]> Signed-off-by: mikelam-us <[email protected]> Co-authored-by: Lucas Pavanelli <[email protected]> Co-authored-by: Thiago Castro Ferreira <[email protected]> Co-authored-by: mi…
1 parent b0810c1 commit 5cd973e

File tree

5 files changed

+14
-7
lines changed

5 files changed

+14
-7
lines changed

‎docs/assets/architecture.png‎

510 KB
Loading

‎docs/development/developer_guide.md‎

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,8 +40,13 @@ set LOG_LEVEL=DEBUG
4040
%env LOG_LEVEL=DEBUG
4141
```
4242

43+
## Architecture
4344

44-
## Data Asset Onboard
45+
### Diagram
46+
47+
<img src="../assets/architecture.png" alt="Data Asset Onboard Process" style="height: 50%; width:50%;"/>
48+
49+
### Data Asset Onboard
4550

4651
The image below depicts the onboard process of a data asset (e.g. corpora and datasets):
4752

‎pyproject.toml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ namespaces = true
1010

1111
[project]
1212
name = "aiXplain"
13-
version = "0.2.5rc"
13+
version = "0.2.12"
1414
description = "aiXplain SDK adds AI functions to software."
1515
readme = "README.md"
1616
requires-python = ">=3.5, <4"
@@ -51,7 +51,7 @@ dependencies = [
5151
"filetype>=1.2.0",
5252
"click>=7.1.2,<8.0.0",
5353
"PyYAML>=6.0.1",
54-
"dataclasses-json==0.6.1"
54+
"dataclasses-json>=0.5.2"
5555
]
5656

5757
[project.urls]

‎tests/functional/finetune/data/finetune_test_end2end.json‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -10,17 +10,17 @@
1010
{
1111
"model_name": "aiR",
1212
"model_id": "6499cc946eb5633de15d82a1",
13-
"dataset_name": "Test search dataset metadata",
13+
"dataset_name": "Test search dataset",
1414
"inference_data": "Hello!",
1515
"required_dev": false,
16-
"search_metadata": true
16+
"search_metadata": false
1717
},
1818
{
1919
"model_name": "vectara",
2020
"model_id": "655e20f46eb563062a1aa301",
21-
"dataset_name": "Test search dataset metadata",
21+
"dataset_name": "Test search dataset",
2222
"inference_data": "Hello!",
2323
"required_dev": false,
24-
"search_metadata": true
24+
"search_metadata": false
2525
}
2626
]

‎tests/functional/finetune/finetune_functional_test.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -83,6 +83,8 @@ def test_end2end(run_input_map):
8383
time.sleep(5)
8484
end = time.time()
8585
assert finetune_model.check_finetune_status().model_status.value == "onboarded"
86+
time.sleep(30)
87+
print(f"Model dict: {finetune_model.__dict__}")
8688
result = finetune_model.run(run_input_map["inference_data"])
8789
print(f"Result: {result}")
8890
assert result is not None

0 commit comments

Comments
 (0)