极客观点
项目管理
HarmonyOS
有没有从mysql或者mariadb 中迁移增量数据到 PostgreSQL 或 Greenplum的相关方案呢？
目前有使用过阿里的mysql2gp这个工具，数据全量迁移没有问题，但通过解析binlog迁移增量数据的时候遇到了一些问题，当需要同步的表格数量非常多的时候，进程进自动退出GP，下面是堆栈信息
[root@Local-GP1 corefile]# gdb core-addr2line-11-530-530-7733-1493717638
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-92.el6)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /usr/bin/addr2line...Reading symbols from /usr/lib/debug/usr/bin/addr2line.debug...done.
done.
[New Thread 7733]
Reading symbols from /usr/lib64/libbfd-2.20.51.0.2-5.44.el6.so...Reading symbols from /usr/lib/debug/usr/lib64/libbfd-2.20.51.0.2-5.44.el6.so.debug...done.
done.
Loaded symbols for /usr/lib64/libbfd-2.20.51.0.2-5.44.el6.so
Reading symbols from /opt/greenplum/greenplum-db/./lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/greenplum/greenplum-db/./lib/libz.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/modules/2.6.32-642.15.1.el6.x86_64/vdso/vdso.so...Reading symbols from /usr/lib/debug/lib/modules/2.6.32-642.15.1.el6.x86_64/vdso/vdso.so.debug...done.
done.
Loaded symbols for /lib/modules/2.6.32-642.15.1.el6.x86_64/vdso/vdso.so
Core was generated by `addr2line -s -e /opt/greenplum/greenplum-db-4.3.12.0/bin/postgres 0xb04062 0xb0'.
Program terminated with signal 11, Segmentation fault.
#0 read_abbrevs (abfd=0x1d84060, section=<value optimized out>, offset=<value optimized out>, symbol=0x0, symbols=0x4, filename_ptr=0x6059b8, functionname_ptr=0x6059c0, linenumber_ptr=0x6059c8,
addr_size=<value optimized out>, pinfo=0x1d845b0) at ./dwarf2.c:663
663 cur_abbrev->number = abbrev_number;
Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.192.el6.x86_64
(gdb) bt
#0 read_abbrevs (abfd=0x1d84060, section=<value optimized out>, offset=<value optimized out>, symbol=0x0, symbols=0x4, filename_ptr=0x6059b8, functionname_ptr=0x6059c0, linenumber_ptr=0x6059c8,
addr_size=<value optimized out>, pinfo=0x1d845b0) at ./dwarf2.c:663
#1 parse_comp_unit (abfd=0x1d84060, section=<value optimized out>, offset=<value optimized out>, symbol=0x0, symbols=0x4, filename_ptr=0x6059b8, functionname_ptr=0x6059c0, linenumber_ptr=0x6059c8,
addr_size=<value optimized out>, pinfo=0x1d845b0) at ./dwarf2.c:2131
#2 find_line (abfd=0x1d84060, section=<value optimized out>, offset=<value optimized out>, symbol=0x0, symbols=0x4, filename_ptr=0x6059b8, functionname_ptr=0x6059c0, linenumber_ptr=0x6059c8,
addr_size=<value optimized out>, pinfo=0x1d845b0) at ./dwarf2.c:3187
#3 0x00007fdf263b0347 in _bfd_dwarf2_find_nearest_line (abfd=<value optimized out>, section=<value optimized out>, symbols=<value optimized out>, offset=<value optimized out>,
filename_ptr=<value optimized out>, functionname_ptr=<value optimized out>, linenumber_ptr=0x6059c8, addr_size=0, pinfo=0x1d845b0) at ./dwarf2.c:3258
#4 0x00007fdf263bc9da in _bfd_elf_find_nearest_line (abfd=0x1d84060, section=0x1d87210, symbols=0x7fdf26837010, offset=6579362, filename_ptr=0x6059b8, functionname_ptr=0x6059c0, line_ptr=0x6059c8)
at elf.c:7330
#5 0x0000000000401cd0 in find_address_in_section (abfd=<value optimized out>, section=<value optimized out>, data=<value optimized out>) at addr2line.c:161
#6 0x00007fdf263a00ac in bfd_map_over_sections (abfd=0x1d84060, operation=0x401c70 <find_address_in_section>, user_storage=0x0) at section.c:1299
#7 0x0000000000402126 in translate_addresses (argc=18, argv=0x7fff654ac1b8) at addr2line.c:216
#8 process_file (argc=18, argv=0x7fff654ac1b8) at addr2line.c:316
mysql
楼主，mysql到greenplum的增量同步，你这边有解决方案吗？上面那个问题你这边解决了吗？