场景:
将MySQL内 json格式数据传输至mongodb内;
mysql内:其实是个数组,由于mysql没有描述数组的数据类型,用的json,格式如下:
"Operator":[{"Id": 88055752, "ValueA": null, "ValueB": "ZZ123", "ValueC": "张三"},{"Id": 88055753, "ValueA": null, "ValueB": "ZZ124", "ValueC": "李四"}]
数据传输工具用的开源DATAX,其他工具也有好用的直接能转的但数据量大,DATAX胜在稳定;
问题:DATAX会将json字段增加转义字符,传输报错,最后各种修改源端数据格式,传到mongodb内如此格式:
"Operator":
"{"Id": 88055752, "ValueA": null, "ValueB": "ZZ123", "ValueC": "张三"}",
"{"Id": 88055753, "ValueA": null, "ValueB": "ZZ124", "ValueC": "李四"}"
需求:
mongodb内格式化数据,数组内元素原始格式为字符串,转换为对象
"Operator":
{"Id": 88055752, "ValueA": null, "ValueB": "ZZ123", "ValueC": "张三"},
{"Id": 88055753, "ValueA": null, "ValueB": "ZZ124", "ValueC": "李四"}