-
Notifications
You must be signed in to change notification settings - Fork 4
Changelog
Nicolas Morales edited this page Feb 23, 2023
·
107 revisions
- Fixes testing
- None
- Upload and processing of EarthSense ground rover Lidar point clouds
- Extraction of plot level point cloud phenotypes
- Database patch:
sgn/db/00164/AddEarthSenseCollectionsCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00165/UpdateMaterializedViewTrialDesigns.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database ISOL ontology update:
sgn/ontology/imagesol.obo. To apply this change, make sure to setRUN_DB_ONTOLOGY_ISOL_UPDATES=TRUEin thedocker-compose.ymlbefore starting the service. - Database G2F ontology update:
sgn/ontology/G2F.obo. To apply this change, make sure to setRUN_DB_ONTOLOGY_G2F_UPDATES=TRUEin thedocker-compose.ymlbefore starting the service.
- Upload of 10-channel aerial imagery, such as from MicaSense dual camera setup.
- Upload of stitched orthomosaics (10-channel or 5-channel) as multi-band stacks from Agisoft.
- Database patch:
sgn/db/00164/AddMicaSenseDoubleCameraProjectMdImageCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00164/AddRoverVehicleCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database ISOL ontology update:
sgn/ontology/imagesol.obo. To apply this change, make sure to setRUN_DB_ONTOLOGY_ISOL_UPDATES=TRUEin thedocker-compose.ymlbefore starting the service.
- Move genotyping plates into genotyping projects
- Can change dates of an imaging event
- Database patch:
sgn/db/00164/UpdatePhenotypeMaterializedViewFixTimeTerms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Changes to genotyping project interface.
- Can associate field trials to imaging event afterwards.
- Database patch:
sgn/db/00162/AddGenotypingProjectCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Include facility indentifiers for genotyping plates.
- Better metabolomics data upload
- Database patch:
sgn/db/00161/AddFacilityIdentifierCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00163/UpdateSpPersonAdminField.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Better georeferenced plot-polygons from aerial imagery.
- Database patch:
sgn/db/00160/AddTrialSoilDataCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00162/AddOriginallyUploadedGeoTIFFCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00162/AddSensoryTrialType.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Better georeferenced plot-polygons from aerial imagery.
- Showing georeferenced plot-polygons on trial detail page.
- Database patch:
sgn/db/00162/AddGeoParamsGPSCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Better drone image analytics
- None
- Starting work on ground rover lidar data upload
- Debian Bullseye, R4.2.0, PostgreSQL 14 environment (REQUIRES RELOAD OF DATABASE. GOING FROM PostgreSQL 12 to 14.)
- Database patch:
sgn/db/00161/AddDroneRunGroundRoverCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Save aerial imaging orthophoto type (OpenDroneMap, Pix4D, etc.)
- Upload OpenDroneMap stacked image (.tif) for 5 bands
- Database patch:
sgn/db/00161/AddDroneRunOrthophotoTypeCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Better field trial analyse for spatial 2DSpl corrections and random regression permanent environment (PE)
- None
- Save and share raw image captures for imaging event, alongside stitched orthophoto images.
- Database patch:
sgn/db/00160/AddProjectTableTypeCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Drone imagery analytics with better GRM support.
- Change in genotype data dosage (DS) storage.
- Database patch:
sgn/db/00157/AddTrialStatusCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00160/GenotypeDosageChange.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00160/AddGRMGenotypingProtocolCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Fixes JS error on startup.
- Faster GRM creation.
- None
- Use GRM protocol in drone image analytics, with better GRM caching.
- Better timing for running drone image standard processes.
- If you have a
sgn_local.confmounted in thedocker-compose.yml, add the following key value line into yoursgn_local.conf:
image_analysis_log /home/production/archive/breedbase/image_analysis.log
- Fall back onto Debian 10, R 3.6.3, Sommer 4.1.3 because better Sommer 2DSpl results.
- Parallelized GRM construction for speed.
- None
- Downgraded R Sommer to 4.1.3 from 4.1.5 because spl2D differences.
- Fixes bug with matview refreshing.
- None
- Fixes bug loading imaging vehicles.
- Fixes bug with JS.
- None
- Data privacy settings for separating companies and users.
- Point cloud support.
- Database patch:
sgn/db/00158/AddCompanyPrivateAccessCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00158/AddMoreStitchingReportandODMCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00159/AddCamelinaSativaOrganism.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00159/SaveDefaultCompanyUserAccess.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Fixes bug on trial detail page.
- None
- Save OpenDroneMap report and point cloud (.ply).
- Upload stock relatedness (e.g. genomic relationships) data.
- Database patch:
sgn/db/00157/CreateStockRelatednessTable.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00157/UpdateCompanyCity.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00158/AddStitchingReportandODMCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00158/UpdateStockRelatednessProject.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Drag GCP generated template. Fixed scaling issue of template and GCPs.
- Database patch:
sgn/db/00155/AddFileMetadataJsonCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00156/AddPolygonTemplateMetadataCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00156/AddProjectTypeId.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Allow brightening of image during standard process.
- None
- Ground control points (GCPs) allow templating of many imaging events at once (e.g. the orthophoto image contains many field trials in it).
- Drag GCP generated template. Fixed scaling issue of template and GCPs.
- Data separation database patches.
- Database patch:
sgn/db/00155/CreatePrivateCompanyTable.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00155/UpdatePhenotypeMaterializedViewPrivateCompany.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00156/AddPrivateCompanyMdImage.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Fix dragging plot-polygon template with margins.
- Prevent adding ontology terms to protected ontologies.
- None
- Upload an imaging event to many field trials at once (e.g. the orthophoto image contains many field trials in it).
- Template an imaging event in the Standard Process for many field trials at once. During templating, upload a spreadsheet to assign polygon numbers to plot numbers of many field trials.
- Visualize plot-image phenotype margins during Standard Process, and afterward can regenerate phenotypes for different margins.
- Database patch:
sgn/db/00154/AddFamilyTypeCvterm.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database patch:
sgn/db/00154/AddLinkedImagingEventCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Interface changes, including Buy ImageBreed a Coffee link.
- None
- BrAPI v2 Observations call is faster
- Database patch:
sgn/db/00154/UpdatePhenotypeMaterializedViewAdditionalPhenotypeProps.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service.
- Includes Canopy Cover Canopeo algorithm (CCC) vegetation index.
- Docker can run database patches or ontology updates on
docker-compose up -dwhenRUN_DB_PATCHES=TRUEorRUN_DB_ONTOLOGY_XXX_UPDATES=TRUE, respectively, is set in thedocker-compose.yml. - High-dimensional phenotypes store additional "device_id" and "comments" for each recording.
- Database patch:
sgn/db/00154/AddCCCVegetationIndexCvterms.pm. To apply this change, make sure to setRUN_DB_PATCHES=TRUEin thedocker-compose.ymlbefore starting the service. - Database ISOL ontology update:
sgn/ontology/imagesol.obo. To apply this change, make sure to setRUN_DB_ONTOLOGY_ISOL_UPDATES=TRUEin thedocker-compose.ymlbefore starting the service.
- Restrict maximum number of standard processes running at once.
- None
- More aerial imagery analyses.
- Database patch: sgn/db/00153/AddEntryNumberCvterm.pm
- Better support for repeated measurements.
- Interface to edit management factor details.
- None
- Interactive plot-polygon tool for aerial image processing with polygon margin buffering.
- More spatial correction analyses.
- Docker images are faster to update now.
- Database patch: sgn/db/00153/SaveChromosomeRankInNdProtocolFix.pm
- Interactive plot-polygon tool for aerial image processing with polygon margin buffering.
- Ability to change upper and lower threshold values.
- Ability to change polygon margin buffering when extracting zonal statistics.
- Database patch: sgn/db/00152/AddPlotPolygonMarginsPhenotypeCvterm.pm
- Interactive plot-polygon tool for aerial image processing.
- Add subplots to a trial from trial detail page. Plants can be added to subplots.
- Database patch: sgn/db/00150/AddPhenotypeAdditionalInfoCvterm.pm
- Database patch: sgn/db/00150/CreateMaterializedMarkerviewUpdated2.pm
- Database patch: sgn/db/00151/SaveChromosomeRankInNdProtocol.pm
- Allow for multiple logins per user across different devices.
- Database patch: sgn/db/00147/CreateSpTokenTable.pm
- Improved spatial analytics.
- SSR genotyping data management.
- Database patch: sgn/db/00148/AddPCRMarkerCvterms.pm
- Database patch: sgn/db/00148/UpdatePhenotypeMaterializedViewGenotypingProjects.pm
- Sequence metadata and genotype querying system.
- Various bug fixes
- Database patch: sgn/db/00147/CreateMaterializedMarkerview.pm
- Database patch: sgn/db/00147/CreateMaterializedMarkerviewUpdated.pm
- Fixes OpenDroneMap orthophoto saving.
- None
- Georeferencing aerial-image derived plot-polygons.
- Catalog ordering of accessions.
- Database patch: sgn/db/00145/AddCatalogRelatedCvterms.pm
- Database patch: sgn/db/00145/AddOrderTables.pm
- Database patch: sgn/db/00145/AddSpOrderPropertyCvAndCvterm.pm
- Database patch: sgn/db/00145/AddVendorRole.pm
- Database patch: sgn/db/00146/AddDroneRunResizeRatioCvterm.pm
- Database patch: sgn/db/00146/AddGeoCoordinateParamPolygonsCvterm.pm
- Database patch: sgn/db/00146/AddRotateKeepOriginalSizeCvterm.pm
- Database patch: sgn/db/00146/UpdatePhenotypeMaterializedViewSpeed.pm
- NOAA NCDC weather plotting tool.
- None
- Drone imagery analytics
- Database patch: sgn/db/00143/AddAdditionalInfoType.pm
- Database patch: sgn/db/00144/AddMiscellaneousTrialType.pm
- Drone imagery analytics with cross validation
- Database patch: sgn/db/00144/FixMatviewsTable.pm
- Fixes bug with OpenDroneMap stitching.
- Minor cosmetic changes to ImageBreed skin.
- Database patch: sgn/db/00143/UpdateMetadataMdImageTableCharacterLength.pm
- Minor bug fixes
- Database patch: sgn/db/00143/UpdatePhenotypeJSONbMaterializedViewTissueSampleFix.pm
- Bulk upload imaging events previously processed using ArcGIS or other GIS software. Allows bulk upload of GeoTiffs and GeoJSON files to define imaging events, define plot-polygons, excise plot-images, and extract plot-phenotypes into the database automatically.
- Database patch: sgn/db/00142/AddImagingEventGeoParamCoordinatesUTMWGSCvterm.pm
- Database patch: sgn/db/00141/AddVcfType.pm
- Removed 2GB limit when uploading imaging events either one at a time, in bulk, or in bulk with provided GeoJSON.
- When uploading imaging events in bulk with GeoJSON files, an angle rotation can be supplied.
- None
- Bulk download imaging events
- None
- Bulk upload imaging events previously processed using ArcGIS or other GIS software. Allows bulk upload of GeoTiffs and GeoJSON files to define imaging events, define plot-polygons, excise plot-images, and extract plot-phenotypes into the database automatically.
- Fixes bug when uploading duplicate genotypes to the same genotyping protocol.
- Database patch: sgn/db/00142/AddImagingEventGeoParamCoordinatesCvterm.pm
- Bulk upload imaging events
- None
- Apply the same aerial imagery standard process to other imaging events.
- None
- Database patches are run automatically on start up, making updating between releases easier (e.g. v4.0 to v4.1). Consult the
docker-compose.ymlto make sureRUN_DB_PATCHES=TRUEand the database parameters are provided in the environment.
- Database patch: sgn/db/00140/AddVendorSubmissionIDProjectProp.pm
- Better OpenDroneMap integration.
- Bulk upload of imaging events.
- Database patch: sgn/db/00141/AddImagingEventBaseDateCvterm.pm
- Better OpenDroneMap integration.
- Environmental simulation analytics improvements.
- Database patch: sgn/db/00140/AddAnalysisSingleMultiTrialCvterm.pm
- Database patch: sgn/db/00140/AddDroneImageryODMRunningCvterm.pm
- Database patch: sgn/db/00140/CreateProjectOwnerTable.pm
- Tools to store genomic sequence metadata.
- Environmental simulation analytics improvements.
- Database patch: sgn/db/00139/AddNdProtocolTerms.pm
- Database patch: sgn/db/00139/AddSequenceMetadataTypes.pm
- Database patch: sgn/db/00139/CreateFeaturepropJSONTable.pm
- OpenDroneMap orthophotomosaic support for MicaSense 5-channel images and color camera images.
- Download relationship matrix from high-dimensional phenotype data (NIRS, Transcriptomics, Metabolomics).
- None
- OpenDroneMap orthophotomosaic support for MicaSense 5-channel images.
- None
- OpenDroneMap orthophotomosaic support in progress.
- Upload of additional cross properties.
- Interactive mapping tool for specifying geo-coordinates of plots in the field.
- Database patch: sgn/db/00138/AddCrossAdditionalInfoCvterm.pm
- Greatly reduced size of Docker image.
- Drone imagery statistics/analytics for minimizing and simulating spatial environmental effects.
- Database patch: sgn/db/00137/FixFieldbookImageCvterm.pm
- Database TREAT ontology update: sgn/ontology/cxgn_plant_treatment.obo
- Database ALF new ontology (trait ontology): sgn/ontology/Alfalfa.obo
- Improvements to Analytics protocols for Environment Simulation studies of Drone Imagery analyses.
- None
- Genotypes can be uploaded (e.g. using VCF file) for mixed stock types (accessions, tissue samples, plots, etc).
- Analytics protocols can be saved for Environment Simulation studies of Drone Imagery analyses.
- Database patch: sgn/db/00134/AddIsPublicDataset.pm
- Database patch: sgn/db/00135/UpdateWizardMaterializedViewsForGenoProtocols.pm
- Database patch: sgn/db/00136/AddAnalyticsProtocolCvterms.pm
- Traits assayed on stock detail page now working.
- High-dimensional phenotype (NIRS, Transcriptomics, Metabolomics) download interface.
- Drone imagery statistics/analytics for minimizing and simulating spatial environmental effects.
- None
- ImageBreed is now running on Debian 10 instead of Debian 9.
- Drone imagery statistics/analytics for minimizing and simulating spatial environmental effects.
- Database patch: sgn/db/00132/AddReleasedVarietyName.pm
- Database patch: sgn/db/00132/AddTraitCvterms.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- Drone imagery statistics/analytics for minimizing and simulating spatial environmental effects.
- High-dimensional phenotype upload for NIRS/Transcriptomics/Metabolomics.
- Database patch: sgn/db/00134/AddCrossTransactionRelatedCvterms.pm
- Drone imagery statistics/analytics for minimizing and simulating spatial environmental effects.
- None
- V2.2.1
- Create or upload a sampling trial to define samples with greater flexibility.
- The NIRS upload is now part of a generic high-dimensional phenotype upload workflow. High-dimensional phenotypes will also work for transcriptomics and metabolomics in the future. High-dimensional phenotypes can be uploaded for samples or other stocks in the database.
- Database patch: sgn/db/00132/AddHighDimPhenotypeProtocolCvterms.pm
- Database patch: sgn/db/00135/AddProtocolColumnToNdExperimentPhenotypeBridge.pm
- Database patch: sgn/db/00136/AddProtocoltoStoredNIRSRetroactively.pm
- High-density genotypic information can now store many millions of markers and genotypes. This was accomplished by separating data by chromosome. It is not necessary to reload or modify previously-stored genotyping data.
- Compute relationship matrix using high-throughput phenotypes and use in analyses.
- None
- V2.0.1
- V2.0.2
- New storage mechanism for phenotypic values, offering greater speed and scalability across the system.
Persistent Database Requirements for upgrading from V1.11. This will take a long time to run depending on the size of your database, so please use a screen session. Please backup your database prior to upgrading to V2.0.
- Backup your database first by logging into where the database is running (e.g.
docker exec -it breedbase_db bash) then create a backup to a file usingpg_dump -U postgres empty_fixture | gzip > YourBreedbase_v1.sql.gz. Keep this backup safe! - Database patch: sgn/db/00132/AddNdExperimentPhenotypeBridge.pm
- Database patch: sgn/db/00133/MigratePhenotypesToNdExperimentPhenotypeBridge.pm
- Database patch: sgn/db/00134/UpdatePhenotypeJsonbTableMaterializedViewForNdExperimentPhenotypeBridge.pm
- Database patch: sgn/db/00134/UpdateWizardMaterializedViewsForNdExperimentPhenotypeBridge.pm
- Export genotyping plates to vendors.
- Fixes aerial imaging event processing for multi-spectral MicaSense when using ground control points.
- Database patch: sgn/db/00130/AddVendorOrderIDProjectProp.pm
- Database patch: sgn/db/00131/AddMixedModelProtocol.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- Properties for accessions can be defined in the configuration file and used when uploading accessions in a file.
- The genotype data upload will check marker information if data is uploaded under the same genotyping protocol (e.g. the reference, alternate, position, info, format, etc. are checked for consistency).
- None
- Product profiles can be defined for breeding programs
- Residuals from drone imagery analyses can be saved
- Seedlot bug was fixed
- Database patch: sgn/db/00131/AddProductProfileCvterm.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- NIRS upload now uses R waves package to aggregate spectra. NIRS spectra can be trained against phenotypes in the database, and the trained model can be used to predict the phenotype for new samples with spectra.
- None
- Aerial image models can use pedigree + genomic relationship matrix
- Database patch: sgn/db/00129/FixPhenomeGenotypingTable.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- Can upload Tassel5 HDF5 genotype data (.h5).
- Model for GBLUP using Sommer
- R version now 3.6.3, so all R packages were updated
- Database patch: sgn/db/00130/AddSommerAnalysisCvterms.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- Fixes models for computing genetic and temporal effects from Legendre polynomial random regressions.
- Compute and save numerical derivatives of phenotypes across rows and columns
- Compute and save precipitation sum from planting date to aerial imaging event date. Similar to growing degree day (GDD) calculation.
- Database patch: sgn/db/00129/AddFamilynameRelatedCvterms.pm
- Database patch: sgn/db/00130/AddAveragePrecipitationSumCvterms.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
- Adds models for computing genetic and temporal effects from Legendre polynomial random regressions.
- Database patch: sgn/db/00129/AddAIREMLf90AndSommerModelCvterms.pm
- Database SGNSTAT ontology update: sgn/ontology/cxgn_statistics.obo
Please support me if you find this open-source software useful!
Please cite ImageBreed if you find this system useful.