使用kettle全量迁移Oracle到MySQL
环境准备
Oracle和MySQL环境准备
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 | -- 创建专用网络 docker network create --subnet=172.72.7.0/24 ora-network -- oracle 压测工具 docker pull lhrbest/lhrdbbench:1.0 docker rm -f lhrdbbench docker run -d --name lhrdbbench -h lhrdbbench \ --net=ora-network --ip 172.72.7.26 \ -v /sys/fs/cgroup:/sys/fs/cgroup \ --privileged=true lhrbest/lhrdbbench:1.0 \ /usr/sbin/init -- Oracle 12c docker rm -f lhrora1221 docker run -itd --name lhrora1221 -h lhrora1221 \ --net=ora-network --ip 172.72.7.34 \ -p 1526:1521 -p 3396:3389 \ --privileged=true \ lhrbest/oracle_12cr2_ee_lhr_12.2.0.1:2.0 init -- mysql docker rm -f mysql8027 docker run -d --name mysql8027 -h mysql8027 -p 3418:3306 \ --net=ora-network --ip 172.72.7.35 \ -v /etc/mysql/mysql8027/conf:/etc/mysql/conf.d \ -e MYSQL_ROOT_PASSWORD=lhr -e TZ=Asia/Shanghai \ mysql:8.0.27 cat > /etc/mysql/mysql8027/conf/my.cnf << "EOF" [mysqld] default-time-zone = '+8:00' log_timestamps = SYSTEM skip-name-resolve log-bin server_id=80273418 character_set_server=utf8mb4 default_authentication_plugin=mysql_native_password EOF mysql -uroot -plhr -h 172.72.7.35 create database lhrdb; -- 业务用户 CREATE USER lhr identified by lhr; alter user lhr identified by lhr; GRANT DBA to lhr ; grant SELECT ANY DICTIONARY to lhr; GRANT EXECUTE ON SYS.DBMS_LOCK TO lhr; -- 启动监听 vi /u01/app/oracle/product/11.2.0.4/dbhome_1/network/admin/listener.ora lsnrctl start lsnrctl status |
kettle环境准备
1 2 3 4 5 6 7 | docker rm -f lhrkettle docker run -itd --name lhrkettle -h lhrkettle \ --net=ora-network --ip 172.72.7.88 \ -p 7390:3389 \ -v /sys/fs/cgroup:/sys/fs/cgroup \ --privileged=true lhrbest/kettle:1.0 \ /usr/sbin/init |
Oracle端数据初始化
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 | -- 源端数据初始化 /usr/local/swingbench/bin/oewizard -s -create -c /usr/local/swingbench/wizardconfigs/oewizard.xml -create \ -version 2.0 -cs //172.72.7.34/lhrsdb -dba "sys as sysdba" -dbap lhr -dt thin \ -ts users -u lhr -p lhr -allindexes -scale 0.0001 -tc 16 -v -cl col TABLE_NAME format a30 SELECT a.table_name,a.num_rows FROM dba_tables a where a.OWNER='LHR' ; select object_type,count(*) from dba_objects where owner='LHR' group by object_type; select object_type,status,count(*) from dba_objects where owner='LHR' group by object_type,status; select sum(bytes)/1024/1024 from dba_segments where owner='LHR'; -- 检查键是否正确:https://www.xmmup.com/ogg-01296-biaoyouzhujianhuoweiyijiandanshirengranshiyongquanbulielaijiexixing.html -- 否则OGG启动后,会报错:OGG-01296、OGG-06439、OGG-01169 Encountered an update where all key columns for target table LHR.ORDER_ITEMS are not present. select owner, constraint_name, constraint_type, status, validated from dba_constraints where owner='LHR' and VALIDATED='NOT VALIDATED'; select 'alter table lhr.'||TABLE_NAME||' enable validate constraint '||CONSTRAINT_NAME||';' from dba_constraints where owner='LHR' and VALIDATED='NOT VALIDATED'; -- 删除外键 SELECT 'ALTER TABLE LHR.'|| D.TABLE_NAME ||' DROP constraint '|| D.CONSTRAINT_NAME||';' FROM DBA_constraints d where owner='LHR' and d.CONSTRAINT_TYPE='R'; sqlplus lhr/lhr@172.72.7.34:1521/lhrsdb @/oggoracle/demo_ora_create.sql @/oggoracle/demo_ora_insert.sql SQL> select * from tcustmer; CUST NAME CITY ST ---- ------------------------------ -------------------- -- WILL BG SOFTWARE CO. SEATTLE WA JANE ROCKY FLYER INC. DENVER CO -- 创建2个clob和blob类型的表 sqlplus lhr/lhr@172.72.7.34:1521/lhrsdb @/oggoracle/demo_ora_lob_create.sql exec testing_lobs; select * from lhr.TSRSLOB; drop table IMAGE_LOB; CREATE TABLE IMAGE_LOB ( T_ID VARCHAR2 (5) NOT NULL, T_IMAGE BLOB, T_CLOB CLOB ); -- 插入blob文件 CREATE OR REPLACE DIRECTORY D1 AS '/home/oracle/'; grant all on DIRECTORY D1 TO PUBLIC; CREATE OR REPLACE NONEDITIONABLE PROCEDURE IMG_INSERT(TID VARCHAR2, FILENAME VARCHAR2, name VARCHAR2) AS F_LOB BFILE; B_LOB BLOB; BEGIN INSERT INTO IMAGE_LOB (T_ID, T_IMAGE,T_CLOB) VALUES (TID, EMPTY_BLOB(),name) RETURN T_IMAGE INTO B_LOB; F_LOB := BFILENAME('D1', FILENAME); DBMS_LOB.FILEOPEN(F_LOB, DBMS_LOB.FILE_READONLY); DBMS_LOB.LOADFROMFILE(B_LOB, F_LOB, DBMS_LOB.GETLENGTH(F_LOB)); DBMS_LOB.FILECLOSE(F_LOB); COMMIT; END; / BEGIN IMG_INSERT('1','1.jpg','xmmup.com'); IMG_INSERT('2','2.jpg','www.xmmup.com'); END; / select * from IMAGE_LOB; ----- oracle所有表 SQL> select * from tab; TNAME TABTYPE CLUSTERID ------------------------------ ------- ---------- ADDRESSES TABLE CARD_DETAILS TABLE CUSTOMERS TABLE IMAGE_LOB TABLE INVENTORIES TABLE LOGON TABLE ORDERENTRY_METADATA TABLE ORDERS TABLE ORDER_ITEMS TABLE PRODUCTS VIEW PRODUCT_DESCRIPTIONS TABLE PRODUCT_INFORMATION TABLE PRODUCT_PRICES VIEW TCUSTMER TABLE TCUSTORD TABLE TSRSLOB TABLE TTRGVAR TABLE WAREHOUSES TABLE 18 rows selected. SELECT COUNT(*) FROM LHR.ADDRESSES UNION ALL SELECT COUNT(*) FROM LHR.CARD_DETAILS UNION ALL SELECT COUNT(*) FROM LHR.CUSTOMERS UNION ALL SELECT COUNT(*) FROM LHR.IMAGE_LOB UNION ALL SELECT COUNT(*) FROM LHR.INVENTORIES UNION ALL SELECT COUNT(*) FROM LHR.LOGON UNION ALL SELECT COUNT(*) FROM LHR.ORDERENTRY_METADATA UNION ALL SELECT COUNT(*) FROM LHR.ORDERS UNION ALL SELECT COUNT(*) FROM LHR.ORDER_ITEMS UNION ALL SELECT COUNT(*) FROM LHR.PRODUCT_DESCRIPTIONS UNION ALL SELECT COUNT(*) FROM LHR.PRODUCT_INFORMATION UNION ALL SELECT COUNT(*) FROM LHR.TCUSTMER UNION ALL SELECT COUNT(*) FROM LHR.TCUSTORD UNION ALL SELECT COUNT(*) FROM LHR.TSRSLOB UNION ALL SELECT COUNT(*) FROM LHR.TTRGVAR UNION ALL SELECT COUNT(*) FROM LHR.WAREHOUSES ; COUNT(*) ---------- 281 281 231 4 900724 575 4 424 1642 1000 1000 2 2 1 0 1000 16 rows selected. |
最终,在Oracle端共包括16张表,2个视图,其中2个表TSRSLOB和IMAGE_LOB包括了blob和clob字段。
kettle配置全量同步
连接到kettle远程桌面:mstsc
用户名和密码:root/lhr
启动kettle图形界面:
1 | sh /usr/local/data-integration/spoon.sh & |
新建Oracle和MySQL的连接,如下:
完成后,会自动生成如下的执行树:
点击run,开始执行即可:
经过15分钟后,迁移完成:
数据校验
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | SELECT COUNT(*) FROM lhrdb.ADDRESSES UNION ALL SELECT COUNT(*) FROM lhrdb.CARD_DETAILS UNION ALL SELECT COUNT(*) FROM lhrdb.CUSTOMERS UNION ALL SELECT COUNT(*) FROM lhrdb.IMAGE_LOB UNION ALL SELECT COUNT(*) FROM lhrdb.INVENTORIES UNION ALL SELECT COUNT(*) FROM lhrdb.LOGON UNION ALL SELECT COUNT(*) FROM lhrdb.ORDERENTRY_METADATA UNION ALL SELECT COUNT(*) FROM lhrdb.ORDERS UNION ALL SELECT COUNT(*) FROM lhrdb.ORDER_ITEMS UNION ALL SELECT COUNT(*) FROM lhrdb.PRODUCT_DESCRIPTIONS UNION ALL SELECT COUNT(*) FROM lhrdb.PRODUCT_INFORMATION UNION ALL SELECT COUNT(*) FROM lhrdb.TCUSTMER UNION ALL SELECT COUNT(*) FROM lhrdb.TCUSTORD UNION ALL SELECT COUNT(*) FROM lhrdb.TSRSLOB UNION ALL SELECT COUNT(*) FROM lhrdb.TTRGVAR UNION ALL SELECT COUNT(*) FROM lhrdb.WAREHOUSES ; |
全量数据迁移完成。
对于blob和clob查看:
可以看到,数据也能正常同步!!!
kettle优化
由于INVENTORIES有90万条的数据,未优化之前需要13分钟,所以,我们可以配置多线程写入,这里配置8个线程写入,发现大约1分钟就可以同步完成:
命令行运行
生成文件后,可以直接在命令行运行:
1 2 3 4 5 6 7 8 | mysql> drop database lhrdb; Query OK, 16 rows affected (2.32 sec) mysql> create database lhrdb; Query OK, 1 row affected (0.10 sec) /usr/local/data-integration/kitchen.sh -file=/root/Desktop/kettle_o2m/job_o2m.kjb /usr/local/data-integration/pan.sh -file=/root/Desktop/kettle_o2m/inventories.ktr |
日志:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 | [root@lhrkettle lib]# /usr/local/data-integration/kitchen.sh -file=/root/Desktop/kettle_o2m/job_o2m.kjb 16:29:29,545 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled 16:29:29,670 INFO [KarafInstance] ******************************************************************************* *** Karaf Instance Number: 1 at /usr/local/data-integration/./system/karaf/ *** *** caches/kitchen/data-1 *** *** Karaf Port:8802 *** *** OSGI Service Port:9051 *** ******************************************************************************* 七月 05, 2022 4:29:31 下午 org.apache.karaf.main.Main$KarafLockCallback lockAcquired 信息: Lock acquired. Setting startlevel to 100 2022/07/05 16:29:31 - Kitchen - Start of run. 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.http.Http1FieldPreEncoder of service org.eclipse.jetty.http.HttpFieldPreEncoder in bundle org.eclipse.jetty.http 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.security.jaspi.JaspiAuthenticatorFactory of service org.eclipse.jetty.security.Authenticator$Factory in bundle org.eclipse.jetty.security.jaspi 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.identity.IdentityExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.fragment.FragmentExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.PerMessageDeflateExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.DeflateFrameExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.XWebkitDeflateFrameExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.JettyClientContainerProvider of service javax.websocket.ContainerProvider in bundle org.eclipse.jetty.websocket.javax.websocket 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerContainerInitializer of service javax.servlet.ServletContainerInitializer in bundle org.eclipse.jetty.websocket.javax.websocket.server 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.server.ContainerDefaultConfigurator of service javax.websocket.server.ServerEndpointConfig$Configurator in bundle org.eclipse.jetty.websocket.javax.websocket.server 七月 05, 2022 4:29:34 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.server.NativeWebSocketServletContainerInitializer of service javax.servlet.ServletContainerInitializer in bundle org.eclipse.jetty.websocket.server 2022-07-05 16:29:34.796:INFO::FelixStartLevel: Logging initialized @8790ms to org.eclipse.jetty.util.log.StdErrLog 七月 05, 2022 4:29:34 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (128) [org.apache.cxf.management.InstrumentationManager] 七月 05, 2022 4:29:34 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-rs-service-description (133) [org.apache.cxf.jaxrs.model.wadl.WadlGenerator] 七月 05, 2022 4:29:34 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (135) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider] 七月 05, 2022 4:29:35 下午 org.apache.cxf.transport.http.osgi.ServletExporter updated 信息: Registering new instance of "/cxf" servlet 七月 05, 2022 4:29:35 下午 org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess 信息: New Caching Service registered 16:29:35,815 INFO [DriverManager] Installing driver kars. 16:29:35,819 INFO [DriverManager] 0 drivers will be installed. 16:29:35,823 INFO [DriverManager] Finished installing drivers kars. 2022-07-05 16:29:35.999:INFO:oejws.WebSocketServerFactory:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:36.161:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): DefaultSessionIdManager workerName=node0 2022-07-05 16:29:36.161:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): No SessionScavenger set, using defaults 2022-07-05 16:29:36.162:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): node0 Scavenging every 660000ms 2022-07-05 16:29:36.224:INFO:oejsh.ContextHandler:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=org.apache.cxf.cxf-rt-transports-http [135], contextID=default]} 2022-07-05 16:29:36.237:INFO:oejs.Server:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): jetty-9.4.18.v20190429; built: 2021-06-30T11:07:22.254Z; git: 526006ecfa3af7f1a27ef3a288e2bef7ea9dd7e8; jvm 1.8.0_332-b09 2022-07-05 16:29:36.317:INFO:oejs.AbstractConnector:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started default@13c27b3{HTTP/1.1, (http/1.1)}{0.0.0.0:9051} 2022-07-05 16:29:36.317:INFO:oejs.Server:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started @10312ms 七月 05, 2022 4:29:36 下午 org.apache.cxf.endpoint.ServerImpl initDestination 信息: Setting the server's publish address to be /i18n 2022-07-05 16:29:36.839:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:36.847:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-i18n-webservice-bundle [218], contextID=default]} 2022-07-05 16:29:38.663:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:38.674:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=org.pentaho.requirejs-manager-impl [248], contextID=default]} 七月 05, 2022 4:29:39 下午 org.apache.cxf.endpoint.ServerImpl initDestination 信息: Setting the server's publish address to be /marketplace 2022-07-05 16:29:39.545:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:39.552:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular [250], contextID=default]} 2022-07-05 16:29:39.910:INFO:oejws.WebSocketServerFactory:FelixDispatchQueue: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:39.924:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:39.926:INFO:oejsh.ContextHandler:FelixDispatchQueue: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-marketplace-di [249], contextID=default]} 2022-07-05 16:29:39.928:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-animate [251], contextID=default]} 2022-07-05 16:29:39.969:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:39.976:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-route [252], contextID=default]} 2022-07-05 16:29:39.991:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:40.000:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-sanitize [253], contextID=default]} 2022-07-05 16:29:40.017:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:40.022:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-translate [254], contextID=default]} 2022-07-05 16:29:40.039:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:40.043:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-ui-bootstrap-bower [255], contextID=default]} 2022-07-05 16:29:40.062:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:40.067:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-jquery [256], contextID=default]} 2022-07-05 16:29:40.086:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:29:40.091:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-underscore [257], contextID=default]} 2022/07/05 16:29:40 - job_o2m - 开始执行任务 2022/07/05 16:29:40 - job_o2m - 开始项[创建表 [PRODUCT_INFORMATION]] Tue Jul 05 16:29:41 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:41 - job_o2m - 开始项[复制数据到 [PRODUCT_INFORMATION]] 2022/07/05 16:29:42 - 复制数据到 [PRODUCT_INFORMATION] - Running transformation using the Kettle execution engine 2022/07/05 16:29:42 - 复制到_ora12cproduct_information_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12cproduct_information_到_mysql8] Tue Jul 05 16:29:42 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:42 - 写到 [PRODUCT_INFORMATION].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:43 - 从 [PRODUCT_INFORMATION].0 - Finished reading query, closing connection 2022/07/05 16:29:43 - 从 [PRODUCT_INFORMATION].0 - 完成处理 (I=1000, O=0, R=0, W=1000, U=0, E=0) 2022/07/05 16:29:44 - 写到 [PRODUCT_INFORMATION].0 - 完成处理 (I=0, O=1000, R=1000, W=1000, U=0, E=0) 2022/07/05 16:29:44 - Carte - Installing timer to purge stale objects after 1440 minutes. 2022/07/05 16:29:44 - job_o2m - 开始项[创建表 [PRODUCT_DESCRIPTIONS]] Tue Jul 05 16:29:44 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:45 - job_o2m - 开始项[复制数据到 [PRODUCT_DESCRIPTIONS]] 2022/07/05 16:29:45 - 复制数据到 [PRODUCT_DESCRIPTIONS] - Running transformation using the Kettle execution engine 2022/07/05 16:29:45 - 复制到_ora12cproduct_descriptions_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12cproduct_descriptions_到_mysql8] Tue Jul 05 16:29:45 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:45 - 写到 [PRODUCT_DESCRIPTIONS].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:45 - 从 [PRODUCT_DESCRIPTIONS].0 - Finished reading query, closing connection 2022/07/05 16:29:45 - 从 [PRODUCT_DESCRIPTIONS].0 - 完成处理 (I=1000, O=0, R=0, W=1000, U=0, E=0) 2022/07/05 16:29:46 - 写到 [PRODUCT_DESCRIPTIONS].0 - 完成处理 (I=0, O=1000, R=1000, W=1000, U=0, E=0) 2022/07/05 16:29:46 - job_o2m - 开始项[创建表 [CARD_DETAILS]] Tue Jul 05 16:29:46 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:46 - job_o2m - 开始项[复制数据到 [CARD_DETAILS]] 2022/07/05 16:29:46 - 复制数据到 [CARD_DETAILS] - Running transformation using the Kettle execution engine 2022/07/05 16:29:46 - 复制到_ora12ccard_details_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12ccard_details_到_mysql8] Tue Jul 05 16:29:46 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:47 - 写到 [CARD_DETAILS].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:47 - 从 [CARD_DETAILS].0 - Finished reading query, closing connection 2022/07/05 16:29:47 - 从 [CARD_DETAILS].0 - 完成处理 (I=281, O=0, R=0, W=281, U=0, E=0) 2022/07/05 16:29:47 - 写到 [CARD_DETAILS].0 - 完成处理 (I=0, O=281, R=281, W=281, U=0, E=0) 2022/07/05 16:29:47 - job_o2m - 开始项[创建表 [TSRSLOB]] Tue Jul 05 16:29:47 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:47 - job_o2m - 开始项[复制数据到 [TSRSLOB]] 2022/07/05 16:29:47 - 复制数据到 [TSRSLOB] - Running transformation using the Kettle execution engine 2022/07/05 16:29:47 - 复制到_ora12ctsrslob_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12ctsrslob_到_mysql8] Tue Jul 05 16:29:47 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:47 - 写到 [TSRSLOB].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:48 - 从 [TSRSLOB].0 - Finished reading query, closing connection 2022/07/05 16:29:48 - 从 [TSRSLOB].0 - 完成处理 (I=1, O=0, R=0, W=1, U=0, E=0) 2022/07/05 16:29:48 - 写到 [TSRSLOB].0 - 完成处理 (I=0, O=1, R=1, W=1, U=0, E=0) 2022/07/05 16:29:48 - job_o2m - 开始项[创建表 [IMAGE_LOB]] Tue Jul 05 16:29:48 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:48 - job_o2m - 开始项[复制数据到 [IMAGE_LOB]] 2022/07/05 16:29:48 - 复制数据到 [IMAGE_LOB] - Running transformation using the Kettle execution engine 2022/07/05 16:29:48 - 复制到_ora12cimage_lob_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12cimage_lob_到_mysql8] Tue Jul 05 16:29:48 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:48 - 写到 [IMAGE_LOB].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:48 - 从 [IMAGE_LOB].0 - Finished reading query, closing connection 2022/07/05 16:29:48 - 从 [IMAGE_LOB].0 - 完成处理 (I=4, O=0, R=0, W=4, U=0, E=0) 2022/07/05 16:29:48 - 写到 [IMAGE_LOB].0 - 完成处理 (I=0, O=4, R=4, W=4, U=0, E=0) 2022/07/05 16:29:48 - job_o2m - 开始项[创建表 [ORDERENTRY_METADATA]] Tue Jul 05 16:29:48 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:49 - job_o2m - 开始项[复制数据到 [ORDERENTRY_METADATA]] 2022/07/05 16:29:49 - 复制数据到 [ORDERENTRY_METADATA] - Running transformation using the Kettle execution engine 2022/07/05 16:29:49 - 复制到_ora12corderentry_metadata_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12corderentry_metadata_到_mysql8] Tue Jul 05 16:29:49 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:49 - 写到 [ORDERENTRY_METADATA].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:49 - 从 [ORDERENTRY_METADATA].0 - Finished reading query, closing connection 2022/07/05 16:29:49 - 从 [ORDERENTRY_METADATA].0 - 完成处理 (I=4, O=0, R=0, W=4, U=0, E=0) 2022/07/05 16:29:49 - 写到 [ORDERENTRY_METADATA].0 - 完成处理 (I=0, O=4, R=4, W=4, U=0, E=0) 2022/07/05 16:29:49 - job_o2m - 开始项[创建表 [LOGON]] Tue Jul 05 16:29:49 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:49 - job_o2m - 开始项[复制数据到 [LOGON]] 2022/07/05 16:29:49 - 复制数据到 [LOGON] - Running transformation using the Kettle execution engine 2022/07/05 16:29:49 - 复制到_ora12clogon_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12clogon_到_mysql8] Tue Jul 05 16:29:49 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:49 - 写到 [LOGON].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:50 - 从 [LOGON].0 - Finished reading query, closing connection 2022/07/05 16:29:50 - 从 [LOGON].0 - 完成处理 (I=575, O=0, R=0, W=575, U=0, E=0) 2022/07/05 16:29:50 - 写到 [LOGON].0 - 完成处理 (I=0, O=575, R=575, W=575, U=0, E=0) 2022/07/05 16:29:50 - job_o2m - 开始项[创建表 [ORDER_ITEMS]] Tue Jul 05 16:29:50 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:51 - job_o2m - 开始项[复制数据到 [ORDER_ITEMS]] 2022/07/05 16:29:51 - 复制数据到 [ORDER_ITEMS] - Running transformation using the Kettle execution engine 2022/07/05 16:29:51 - 复制到_ora12corder_items_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12corder_items_到_mysql8] Tue Jul 05 16:29:51 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:51 - 写到 [ORDER_ITEMS].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:51 - 从 [ORDER_ITEMS].0 - Finished reading query, closing connection 2022/07/05 16:29:51 - 从 [ORDER_ITEMS].0 - 完成处理 (I=1642, O=0, R=0, W=1642, U=0, E=0) 2022/07/05 16:29:53 - 写到 [ORDER_ITEMS].0 - 完成处理 (I=0, O=1642, R=1642, W=1642, U=0, E=0) 2022/07/05 16:29:53 - job_o2m - 开始项[创建表 [WAREHOUSES]] Tue Jul 05 16:29:53 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:53 - job_o2m - 开始项[复制数据到 [WAREHOUSES]] 2022/07/05 16:29:53 - 复制数据到 [WAREHOUSES] - Running transformation using the Kettle execution engine 2022/07/05 16:29:53 - 复制到_ora12cwarehouses_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12cwarehouses_到_mysql8] Tue Jul 05 16:29:53 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:53 - 写到 [WAREHOUSES].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:53 - 从 [WAREHOUSES].0 - Finished reading query, closing connection 2022/07/05 16:29:53 - 从 [WAREHOUSES].0 - 完成处理 (I=1000, O=0, R=0, W=1000, U=0, E=0) 2022/07/05 16:29:55 - 写到 [WAREHOUSES].0 - 完成处理 (I=0, O=1000, R=1000, W=1000, U=0, E=0) 2022/07/05 16:29:55 - job_o2m - 开始项[创建表 [CUSTOMERS]] Tue Jul 05 16:29:55 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:55 - job_o2m - 开始项[复制数据到 [CUSTOMERS]] 2022/07/05 16:29:55 - 复制数据到 [CUSTOMERS] - Running transformation using the Kettle execution engine 2022/07/05 16:29:55 - 复制到_ora12ccustomers_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12ccustomers_到_mysql8] Tue Jul 05 16:29:55 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:55 - 写到 [CUSTOMERS].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:55 - 从 [CUSTOMERS].0 - Finished reading query, closing connection 2022/07/05 16:29:55 - 从 [CUSTOMERS].0 - 完成处理 (I=231, O=0, R=0, W=231, U=0, E=0) 2022/07/05 16:29:56 - 写到 [CUSTOMERS].0 - 完成处理 (I=0, O=231, R=231, W=231, U=0, E=0) 2022/07/05 16:29:56 - job_o2m - 开始项[创建表 [TCUSTORD]] Tue Jul 05 16:29:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:56 - job_o2m - 开始项[复制数据到 [TCUSTORD]] 2022/07/05 16:29:56 - 复制数据到 [TCUSTORD] - Running transformation using the Kettle execution engine 2022/07/05 16:29:56 - 复制到_ora12ctcustord_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12ctcustord_到_mysql8] Tue Jul 05 16:29:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:56 - 写到 [TCUSTORD].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:56 - 从 [TCUSTORD].0 - Finished reading query, closing connection 2022/07/05 16:29:56 - 从 [TCUSTORD].0 - 完成处理 (I=2, O=0, R=0, W=2, U=0, E=0) 2022/07/05 16:29:56 - 写到 [TCUSTORD].0 - 完成处理 (I=0, O=2, R=2, W=2, U=0, E=0) 2022/07/05 16:29:56 - job_o2m - 开始项[创建表 [TTRGVAR]] Tue Jul 05 16:29:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:57 - job_o2m - 开始项[复制数据到 [TTRGVAR]] 2022/07/05 16:29:57 - 复制数据到 [TTRGVAR] - Running transformation using the Kettle execution engine 2022/07/05 16:29:57 - 复制到_ora12cttrgvar_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12cttrgvar_到_mysql8] Tue Jul 05 16:29:57 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:57 - 写到 [TTRGVAR].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:57 - 从 [TTRGVAR].0 - Finished reading query, closing connection 2022/07/05 16:29:57 - job_o2m - 开始项[创建表 [ORDERS]] Tue Jul 05 16:29:57 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:57 - job_o2m - 开始项[复制数据到 [ORDERS]] 2022/07/05 16:29:57 - 复制数据到 [ORDERS] - Running transformation using the Kettle execution engine 2022/07/05 16:29:57 - 复制到_ora12corders_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12corders_到_mysql8] Tue Jul 05 16:29:57 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:57 - 写到 [ORDERS].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:58 - 从 [ORDERS].0 - Finished reading query, closing connection 2022/07/05 16:29:58 - 从 [ORDERS].0 - 完成处理 (I=424, O=0, R=0, W=424, U=0, E=0) 2022/07/05 16:29:58 - 写到 [ORDERS].0 - 完成处理 (I=0, O=424, R=424, W=424, U=0, E=0) 2022/07/05 16:29:58 - job_o2m - 开始项[创建表 [INVENTORIES]] Tue Jul 05 16:29:58 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:59 - job_o2m - 开始项[创建表 [ADDRESSES]] Tue Jul 05 16:29:59 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:59 - job_o2m - 开始项[复制数据到 [ADDRESSES]] 2022/07/05 16:29:59 - 复制数据到 [ADDRESSES] - Running transformation using the Kettle execution engine 2022/07/05 16:29:59 - 复制到_ora12caddresses_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12caddresses_到_mysql8] Tue Jul 05 16:29:59 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:29:59 - 写到 [ADDRESSES].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:29:59 - 从 [ADDRESSES].0 - Finished reading query, closing connection 2022/07/05 16:29:59 - 从 [ADDRESSES].0 - 完成处理 (I=281, O=0, R=0, W=281, U=0, E=0) 2022/07/05 16:30:00 - 写到 [ADDRESSES].0 - 完成处理 (I=0, O=281, R=281, W=281, U=0, E=0) 2022/07/05 16:30:00 - job_o2m - 开始项[创建表 [TCUSTMER]] Tue Jul 05 16:30:00 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:30:00 - job_o2m - 开始项[复制数据到 [TCUSTMER]] 2022/07/05 16:30:00 - 复制数据到 [TCUSTMER] - Running transformation using the Kettle execution engine 2022/07/05 16:30:00 - 复制到_ora12ctcustmer_到_mysql8 - 为了转换解除补丁开始 [复制到_ora12ctcustmer_到_mysql8] Tue Jul 05 16:30:00 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:30:00 - 写到 [TCUSTMER].0 - Connected to database [mysql8] (commit=100) 2022/07/05 16:30:00 - 从 [TCUSTMER].0 - Finished reading query, closing connection 2022/07/05 16:30:00 - 从 [TCUSTMER].0 - 完成处理 (I=2, O=0, R=0, W=2, U=0, E=0) 2022/07/05 16:30:00 - 写到 [TCUSTMER].0 - 完成处理 (I=0, O=2, R=2, W=2, U=0, E=0) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [TCUSTMER]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [TCUSTMER]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [ADDRESSES]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [ADDRESSES]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [INVENTORIES]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [ORDERS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [ORDERS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [TTRGVAR]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [TTRGVAR]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [TCUSTORD]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [TCUSTORD]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [CUSTOMERS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [CUSTOMERS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [WAREHOUSES]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [WAREHOUSES]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [ORDER_ITEMS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [ORDER_ITEMS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [LOGON]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [LOGON]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [ORDERENTRY_METADATA]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [ORDERENTRY_METADATA]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [IMAGE_LOB]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [IMAGE_LOB]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [TSRSLOB]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [TSRSLOB]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [CARD_DETAILS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [CARD_DETAILS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [PRODUCT_DESCRIPTIONS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [PRODUCT_DESCRIPTIONS]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[复制数据到 [PRODUCT_INFORMATION]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 完成作业项[创建表 [PRODUCT_INFORMATION]] (结果=[true]) 2022/07/05 16:30:00 - job_o2m - 任务执行完毕 2022/07/05 16:30:00 - Kitchen - Finished! 2022/07/05 16:30:00 - Kitchen - Start=2022/07/05 16:29:40.710, Stop=2022/07/05 16:30:00.642 2022/07/05 16:30:00 - Kitchen - Processing ended after 19 seconds. [root@lhrkettle lib]# [root@lhrkettle lib]# /usr/local/data-integration/pan.sh -file=/root/Desktop/kettle_o2m/inventories.ktr 16:30:44,730 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled 16:30:44,832 INFO [KarafInstance] ******************************************************************************* *** Karaf Instance Number: 2 at /usr/local/data-integration/./system/karaf/ *** *** caches/pan/data-1 *** *** Karaf Port:8803 *** *** OSGI Service Port:9052 *** ******************************************************************************* 七月 05, 2022 4:30:46 下午 org.apache.karaf.main.Main$KarafLockCallback lockAcquired 信息: Lock acquired. Setting startlevel to 100 七月 05, 2022 4:30:47 下午 org.apache.felix.fileinstall.internal.Util$DefaultLogger log 信息: Updating configuration {org.apache.karaf.shell} from /usr/local/data-integration/system/karaf/etc/org.apache.karaf.shell.cfg 七月 05, 2022 4:30:47 下午 org.apache.felix.fileinstall.internal.Util$DefaultLogger log 信息: Updating configuration {org.ops4j.pax.web} from /usr/local/data-integration/system/karaf/etc/org.ops4j.pax.web.cfg 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.http.Http1FieldPreEncoder of service org.eclipse.jetty.http.HttpFieldPreEncoder in bundle org.eclipse.jetty.http 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.security.jaspi.JaspiAuthenticatorFactory of service org.eclipse.jetty.security.Authenticator$Factory in bundle org.eclipse.jetty.security.jaspi 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.identity.IdentityExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.fragment.FragmentExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.PerMessageDeflateExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.DeflateFrameExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.common.extensions.compress.XWebkitDeflateFrameExtension of service org.eclipse.jetty.websocket.api.extensions.Extension in bundle org.eclipse.jetty.websocket.common 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.JettyClientContainerProvider of service javax.websocket.ContainerProvider in bundle org.eclipse.jetty.websocket.javax.websocket 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerContainerInitializer of service javax.servlet.ServletContainerInitializer in bundle org.eclipse.jetty.websocket.javax.websocket.server 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.jsr356.server.ContainerDefaultConfigurator of service javax.websocket.server.ServerEndpointConfig$Configurator in bundle org.eclipse.jetty.websocket.javax.websocket.server 七月 05, 2022 4:30:49 下午 org.apache.aries.spifly.BaseActivator log 信息: Registered provider org.eclipse.jetty.websocket.server.NativeWebSocketServletContainerInitializer of service javax.servlet.ServletContainerInitializer in bundle org.eclipse.jetty.websocket.server 2022-07-05 16:30:49.464:INFO::FelixStartLevel: Logging initialized @7977ms to org.eclipse.jetty.util.log.StdErrLog 七月 05, 2022 4:30:49 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (128) [org.apache.cxf.management.InstrumentationManager] 七月 05, 2022 4:30:49 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-rs-service-description (133) [org.apache.cxf.jaxrs.model.wadl.WadlGenerator] 七月 05, 2022 4:30:49 下午 org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions 信息: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (135) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider] 七月 05, 2022 4:30:50 下午 org.apache.cxf.transport.http.osgi.ServletExporter updated 信息: Registering new instance of "/cxf" servlet 七月 05, 2022 4:30:50 下午 org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess 信息: New Caching Service registered 16:30:50,906 INFO [DriverManager] Installing driver kars. 16:30:50,910 INFO [DriverManager] 0 drivers will be installed. 16:30:50,912 INFO [DriverManager] Finished installing drivers kars. 2022-07-05 16:30:50.983:INFO:oejws.WebSocketServerFactory:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:51.167:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): DefaultSessionIdManager workerName=node0 2022-07-05 16:30:51.167:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): No SessionScavenger set, using defaults 2022-07-05 16:30:51.169:INFO:oejs.session:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): node0 Scavenging every 660000ms 2022-07-05 16:30:51.225:INFO:oejsh.ContextHandler:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=org.apache.cxf.cxf-rt-transports-http [135], contextID=default]} 2022-07-05 16:30:51.235:INFO:oejs.Server:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): jetty-9.4.18.v20190429; built: 2021-06-30T11:07:22.254Z; git: 526006ecfa3af7f1a27ef3a288e2bef7ea9dd7e8; jvm 1.8.0_332-b09 2022-07-05 16:30:51.300:INFO:oejs.AbstractConnector:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started default@2e2310de{HTTP/1.1, (http/1.1)}{0.0.0.0:9052} 2022-07-05 16:30:51.300:INFO:oejs.Server:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started @9814ms 七月 05, 2022 4:30:51 下午 org.apache.cxf.endpoint.ServerImpl initDestination 信息: Setting the server's publish address to be /i18n 2022-07-05 16:30:51.977:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:51.985:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-i18n-webservice-bundle [218], contextID=default]} 2022-07-05 16:30:53.810:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:53.817:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=org.pentaho.requirejs-manager-impl [248], contextID=default]} 七月 05, 2022 4:30:54 下午 org.apache.cxf.endpoint.ServerImpl initDestination 信息: Setting the server's publish address to be /marketplace 2022-07-05 16:30:54.584:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:54.588:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular [250], contextID=default]} 2022-07-05 16:30:54.603:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:54.609:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-animate [251], contextID=default]} 2022-07-05 16:30:54.980:INFO:oejws.WebSocketServerFactory:FelixDispatchQueue: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:54.997:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:54.998:INFO:oejsh.ContextHandler:FelixDispatchQueue: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-marketplace-di [249], contextID=default]} 2022-07-05 16:30:55.004:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-route [252], contextID=default]} 2022-07-05 16:30:55.022:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:55.034:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-sanitize [253], contextID=default]} 2022-07-05 16:30:55.050:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:55.055:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-translate [254], contextID=default]} 2022-07-05 16:30:55.071:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:55.076:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-angular-ui-bootstrap-bower [255], contextID=default]} 2022-07-05 16:30:55.095:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:55.100:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-jquery [256], contextID=default]} 2022-07-05 16:30:55.118:INFO:oejws.WebSocketServerFactory:FelixStartLevel: No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1] 2022-07-05 16:30:55.122:INFO:oejsh.ContextHandler:FelixStartLevel: Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=pentaho-webjars-underscore [257], contextID=default]} 2022/07/05 16:30:55 - Pan - Start of run. 2022/07/05 16:30:55 - 复制到_ora12cinventories_到_mysql8 - Dispatching started for transformation [复制到_ora12cinventories_到_mysql8] Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Jul 05 16:30:56 CST 2022 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2022/07/05 16:30:56 - 写到 [INVENTORIES].1 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].6 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].0 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].3 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].5 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].2 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].7 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:56 - 写到 [INVENTORIES].4 - Connected to database [mysql8] (commit=10000) 2022/07/05 16:30:58 - 从 [INVENTORIES].0 - linenr 50000 2022/07/05 16:30:59 - 从 [INVENTORIES].0 - linenr 100000 2022/07/05 16:31:00 - 从 [INVENTORIES].0 - linenr 150000 2022/07/05 16:31:06 - 从 [INVENTORIES].0 - linenr 200000 2022/07/05 16:31:09 - 从 [INVENTORIES].0 - linenr 250000 2022/07/05 16:31:10 - 从 [INVENTORIES].0 - linenr 300000 2022/07/05 16:31:13 - 从 [INVENTORIES].0 - linenr 350000 2022/07/05 16:31:14 - 从 [INVENTORIES].0 - linenr 400000 2022/07/05 16:31:16 - 从 [INVENTORIES].0 - linenr 450000 2022/07/05 16:31:18 - 写到 [INVENTORIES].0 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].1 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].5 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].7 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].4 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].3 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].2 - linenr 50000 2022/07/05 16:31:18 - 写到 [INVENTORIES].6 - linenr 50000 2022/07/05 16:31:19 - 从 [INVENTORIES].0 - linenr 500000 2022/07/05 16:31:20 - 从 [INVENTORIES].0 - linenr 550000 2022/07/05 16:31:23 - 从 [INVENTORIES].0 - linenr 600000 2022/07/05 16:31:25 - 从 [INVENTORIES].0 - linenr 650000 2022/07/05 16:31:26 - 从 [INVENTORIES].0 - linenr 700000 2022/07/05 16:31:29 - 从 [INVENTORIES].0 - linenr 750000 2022/07/05 16:31:30 - 从 [INVENTORIES].0 - linenr 800000 2022/07/05 16:31:31 - 从 [INVENTORIES].0 - linenr 850000 2022/07/05 16:31:33 - 写到 [INVENTORIES].0 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].1 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].5 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].7 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].2 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].4 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].3 - linenr 100000 2022/07/05 16:31:33 - 写到 [INVENTORIES].6 - linenr 100000 2022/07/05 16:31:34 - 从 [INVENTORIES].0 - linenr 900000 2022/07/05 16:31:34 - 从 [INVENTORIES].0 - Finished reading query, closing connection 2022/07/05 16:31:34 - 从 [INVENTORIES].0 - Finished processing (I=900724, O=0, R=0, W=900724, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].1 - Finished processing (I=0, O=112591, R=112591, W=112591, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].0 - Finished processing (I=0, O=112591, R=112591, W=112591, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].5 - Finished processing (I=0, O=112590, R=112590, W=112590, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].7 - Finished processing (I=0, O=112590, R=112590, W=112590, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].6 - Finished processing (I=0, O=112590, R=112590, W=112590, U=0, E=0) 2022/07/05 16:31:37 - 写到 [INVENTORIES].4 - Finished processing (I=0, O=112590, R=112590, W=112590, U=0, E=0) 2022/07/05 16:31:38 - 写到 [INVENTORIES].2 - Finished processing (I=0, O=112591, R=112591, W=112591, U=0, E=0) 2022/07/05 16:31:38 - 写到 [INVENTORIES].3 - Finished processing (I=0, O=112591, R=112591, W=112591, U=0, E=0) 2022/07/05 16:31:38 - Carte - Installing timer to purge stale objects after 1440 minutes. 2022/07/05 16:31:38 - Pan - Finished! 2022/07/05 16:31:38 - Pan - Start=2022/07/05 16:30:55.896, Stop=2022/07/05 16:31:38.063 2022/07/05 16:31:38 - Pan - Processing ended after 42 seconds. 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 从 [INVENTORIES].0 ended successfully, processed 900724 lines. ( 21445 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].0 ended successfully, processed 112591 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].1 ended successfully, processed 112591 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].2 ended successfully, processed 112591 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].3 ended successfully, processed 112591 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].4 ended successfully, processed 112590 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].5 ended successfully, processed 112590 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].6 ended successfully, processed 112590 lines. ( 2680 lines/s) 2022/07/05 16:31:38 - 复制到_ora12cinventories_到_mysql8 - Step 写到 [INVENTORIES].7 ended successfully, processed 112590 lines. ( 2680 lines/s) |
总结
1、全量初始化比较快,BLOB和CLOB也可以同步。
2、问题:开启并行复制后,偶尔发现有数据丢失的问题,我大概定位到是由于插入之前没有手工做“清空表的操作”,而是让kettle做清空表的动作,大概率跟这个有关系。大家若有大表单独导入,请在导入之前,手工执行truncate操作。
3、“工具->向导->复制多表向导”或快捷键“ctrl+f10”复制会同时复制表结构,然后在MySQL中对不正确的结构做修改后,可以从MySQL导出DDL语句,后续同步,只需要同步数据,而不用同步表结构了。如果MySQL中已经存在相关的表了,那么kettle不会再自动生成表结构了。
4、对于大表的优化,可以修改相关的.ktr
文件,做如下的修改,将能提升很多:
①、配置提交数量:<commit>1000</commit>
,默认为100
②、修改写入的并行数:<copies>8</copies>
,默认为1