Skip to content

Changes

Summary

  1. 调整连接信息serverTimezone => connectionTimeZone (details)
  2. 修改serverTimeZone到ConnectTimeZone后修复变量问题 (details)
  3. 提交重试操作 (details)
  4. hotfix: 调整重试机制及异常处理方式 (details)
  5. 调整重试逻辑 (details)
  6. 调整重试逻辑 (details)
  7. 添加输出序列化的日志 (details)
Commit 84b91dde102c015dbf02ec2dc1fef6c7549ad6c4 by linhancheng
调整连接信息serverTimezone => connectionTimeZone
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-dispatch-task/src/main/resources/jdbcs/task-te.properties
The file was modified src/streaming-event-platform/docs/scripts/flinkJob.db.sql
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/salary-manage.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/user.json
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job_kafka_2_jdbc_kms-team.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/removed/shopping-product.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/company/flinkjob.sql
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/datasource-default.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/removed/company.json
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-count/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\274\201\344\270\232-\351\251\273\345\213\244-\351\251\273\345\213\244\344\272\272\345\221\230-\344\272\272\345\221\230\344\277\241\346\201\257.json"
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/removed/shopping-product.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/user.json
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/com-prod/company/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\274\201\344\270\232\344\277\241\346\201\257.json"
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/MetaConf.json
The file was modified src/streaming-event-platform/log.file.1
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/entities/JdbcDefinitionEntity.java
The file was modified src/streaming-event-platform/flink-event-job-web-api/src/main/java/com/bcxin/flink/event/job/web/apis/controllers/requests/JdbcDefinitionRequest.java
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job_kafka_2_jdbc.json
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\274\201\344\270\232-\351\251\273\345\213\244-\351\251\273\345\213\244\344\272\272\345\221\230-\344\272\272\345\221\230\344\277\241\346\201\257.json"
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/com-prod/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\274\201\344\270\232-\351\251\273\345\213\244-\351\251\273\345\213\244\344\272\272\345\221\230-\344\272\272\345\221\230\344\277\241\346\201\257.json"
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/company/MetaConf.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/removed/shopping-product.json
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-dispatch-task/src/main/resources/jdbcs/task-com-prod.properties
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-table-task/src/main/resources/jdbcs/task-com-prod.properties
The file was modified src/streaming-event-platform/docs/tableTask-Conf/MetaConf.json
The file was modified src/streaming-event-platform/log.file.3
The file was modified src/streaming-event-platform/flink-event-job-web-api/src/main/java/com/bcxin/flink/event/job/web/apis/controllers/SourceSinkController.java
The file was modified src/streaming-event-platform/flink-event-job-web-api/src/main/resources/application.yml
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/removed/user-credential-details.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/local/user-credential-details.json
The file was modified src/streaming-event-platform/docs/scripts/com-prod/flinkJob.db.sql
The file was modified src/streaming-event-platform/docs/cdc/flink-jobs.sql
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/shopping-account.json
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-deprecated/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\274\201\344\270\232-\351\251\273\345\213\244-\351\251\273\345\213\244\344\272\272\345\221\230-\344\272\272\345\221\230\344\277\241\346\201\257.json"
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job-02.json
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-table-task/src/main/resources/jdbcs/task-te.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-table-task/src/main/resources/configs/com-prod/db.properties
The file was modified src/streaming-event-platform/docs/flink-standalone/sql-client/project/kafka-companyinfocollect-employee
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/others.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/removed/user-credential-details.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/user.json
The file was modified src/streaming-event-platform/docs/scripts/preprod/flink-job.sql
The file was modified src/streaming-event-platform/flink-event-job-web-api/src/main/java/com/bcxin/flink/event/job/web/apis/controllers/responses/JdbcResponse.java
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job_kafka_2_jdbc_tenant_users.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/employees/flinkjob.sql
The file was modified "src/streaming-event-platform/docs/scripts/\351\251\273\345\213\244\344\277\241\346\201\257\344\273\273\345\212\241\345\217\202\346\225\260"
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/others.json
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/jdbcs/task-test2.properties
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/jdbcs/task-te.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/removed/employees.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/preprod/shopping-account.json
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/definitions/JdbcDefinition.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/others.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/salary-manage.json
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/commands/CreateJdbcDefinitionCommand.java
The file was modified src/streaming-event-platform/docs/db/flink-jobs.sql
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/db/TableTask-\344\274\201\344\270\232-\351\251\273\345\213\244-\351\251\273\345\213\244\344\272\272\345\221\230-\344\272\272\345\221\230.sql"
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/commands/UpdateJdbcDefinitionCommand.java
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/datasource-obpm2.properties
The file was modified src/streaming-event-platform/event-tasks/flink-data-webhook-task/src/main/resources/jdbcs/task-com-prod.properties
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/jdbcs/task-dev.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/removed/company.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/local/employees.json
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/local/user.json
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/job_kafka_2_jdbc_kms-team-proc.json
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-table-task/src/main/java/com/bcxin/flink/streaming/table/tasks/components/JdbcSourceDefinitionUtils.java
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/jdbcs/task-preprod.properties
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-dispatch-task/src/main/java/com/bcxin/flink/cdc/dispatch/task/proerpties/CdcDatabaseSourceProperty.java
The file was modified src/streaming-event-platform/docs/flink-standalone/sql-client/kafka-user-credential-sink-dwd-user-info
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-deprecated/flinkjob.sql
The file was modified src/streaming-event-platform/flink-streaming-core/src/main/java/com/bcxin/flink/streaming/cores/JdbcJobExecutorUtil.java
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/services/impls/JdbcDefinitionServiceImpl.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/removed/employees.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-deprecated/MetaConf.json
The file was modified "src/streaming-event-platform/docs/scripts/\345\220\214\346\227\266\346\266\210\350\264\271\345\244\232\350\241\250\347\232\204\344\273\273\345\212\241\345\217\202\346\225\260"
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/JdbcParameterDTO.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/removed/employees.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-count/flinkjob.sql
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/resources/jdbcs/task-com-prod.properties
The file was modified src/streaming-event-platform/docs/cdc/com-prod/flink-jobs.sql
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/java/com/bcxin/flink/cdc/kafka/source/task/jobs/DbStreamCdcJobAbstract.java
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/java/com/bcxin/flink/streaming/computing/task/StreamingJobApp.java
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/jdbcs/task-dev.properties
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/java/com/bcxin/flink/cdc/kafka/source/task/proerpties/CdcDatabaseSourceProperty.java
The file was modified "src/streaming-event-platform/docs/\345\217\202\346\225\260"
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/com-prod/shopping-account.json
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-dispatch-task/src/main/java/com/bcxin/flink/cdc/dispatch/task/jobs/Binlog2DispatchCdcJob.java
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/definitions/JdbcConnectorDefinition.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/removed/company.json
The file was modified src/streaming-event-platform/docs/flink-standalone/env/log4j.properties
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/resources/jdbcs/task-com-prod.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/resources/configs/test2/removed/user-credential-details.json
The file was modified "src/streaming-event-platform/docs/tableTask-Conf/com-prod/employees/TableTaskConf_\345\256\236\346\227\266\345\275\222\351\233\206\344\272\272\345\221\230\344\277\241\346\201\257.json"
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-table-task/src/main/resources/configs/test2/db.properties
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/station-person-count/MetaConf.json
The file was modified src/streaming-event-platform/event-tasks/flink-data-webhook-task/src/main/resources/jdbcs/task-te.properties
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-table-task/src/main/resources/configs/preprod/db.properties
The file was modified src/streaming-event-platform/docs/tableTask-Conf/JdbcMetaConf.json
The file was modified src/streaming-event-platform/docs/tableTask-Conf/com-prod/employees/MetaConf.json
Commit 421c7a63c5f248bcbd115ab5b6e8a3cf3b383de8 by linhancheng
修改serverTimeZone到ConnectTimeZone后修复变量问题
The file was modified src/streaming-event-platform/flink-event-job-web-api/src/main/java/com/bcxin/flink/event/job/web/apis/controllers/SourceSinkController.java
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/definitions/JdbcDefinition.java
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/services/impls/JdbcDefinitionServiceImpl.java
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/JdbcParameterDTO.java
The file was modified src/streaming-event-platform/event-tasks/flink-streaming-computing-task/src/main/java/com/bcxin/flink/streaming/computing/task/StreamingJobApp.java
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-dispatch-task/src/main/java/com/bcxin/flink/cdc/dispatch/task/jobs/Binlog2DispatchCdcJob.java
The file was modified src/streaming-event-platform/event-jobs/event-job-domain/src/main/java/com/bcxin/event/job/domain/entities/JdbcDefinitionEntity.java
The file was modified src/streaming-event-platform/event-tasks/flink-cdc-kafka-source-task/src/main/java/com/bcxin/flink/cdc/kafka/source/task/jobs/DbStreamCdcJobAbstract.java
Commit 7f6f167201375df63e9fe48d2b2942a33a451173 by linhancheng
提交重试操作
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/components/BinlogRawValue.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/components/CustomJdbcOutputFormat.java
The file was addedsrc/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/exceptions/RetryEventException.java
The file was added"src/streaming-event-platform/docs/db/\345\275\222\351\233\206\347\232\204\346\211\247\350\241\214\346\227\245\345\277\227.sql"
The file was addedsrc/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/utils/RetryUtil.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/jobs/DataJobAbstract.java
Commit 1b1eb51e383abcb78509e4b79941d86a3be5480a by linhancheng
hotfix: 调整重试机制及异常处理方式
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/utils/RetryUtil.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/components/CustomJdbcOutputFormat.java
Commit b4c500f34b2e943dcc754ac3cdb85145bed6cec5 by linhancheng
调整重试逻辑
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/components/CustomJdbcOutputFormat.java
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/utils/RetryUtil.java
The file was addedsrc/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/exceptions/AffectedEventException.java
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/jobs/DataJobAbstract.java
Commit aba19c9f405a92ccaf7be965b5691f4475548209 by linhancheng
调整重试逻辑
The file was modified src/streaming-event-platform/event-tasks/tenant-data-etc-task/src/main/java/com/bcxin/tenant/data/etc/tasks/components/CustomJdbcOutputFormat.java
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/utils/RetryUtil.java
Commit 012b46d3eae1793c4a479d020a56e685e8cd3353 by linhancheng
添加输出序列化的日志
The file was modified src/streaming-event-platform/event-core/src/main/java/com/bcxin/event/core/JsonProviderImpl.java