Here are only the breaking and most significant changes. For a full account of changes, please see the commit history.
- Update openmetadata-ingestion lib. It was affecting pydantic version.
- Auto-generate Openmetadata lineage
- Create test suite for db_connection
- Make DBConnection context manager more flexible
- Add timeout to DadosGovBrHook
- New estimated max id parameter
- Add psycopg2 execute_batch to destination table at copy_by_key_interval
- Add export_file on gdrive (GSheetHook)
- Change executemany for execute_batch for postgres for better perfomance
- Include yaml config files on package build
- Adds functionality to create table on destination when source conn_type is teiid.
- Add operator template
- Update README.md and add English version
- Create new DadosGovBrHook
- Added the tabular data package's title and description to the top of
the data dictionary file created by
TabularDataPackageToDataDictionaryOperator
. - Added a
DocumentTemplateToDataDictionaryOperator
that allows for creating a data dictionary from an ODT document template and a tabular data package.