【发布时间】:2020-05-24 23:28:14
【问题描述】:
我有一个带有semi structured data 的数据集,我需要将json 内的content 列转换为其他列。
数据:
customer flow session timestamp content
1 C1000 F1000 S2000 2019-12-16 13:59:58+00:00 {'name': ''}
2 C1000 F1000 S2000 2019-12-16 13:59:59+00:00 {'name': 'joao'}
4 C1000 F1000 S2000 2019-12-16 13:59:59+00:00 {'cpf': '733.600.420-26'}
想要的结果如下所示:
+--------+-----+-------+-------------------+-------------------+-----+--------------+------------------+
|customer|flow |session|first_answer_dt |last_answer_dt |name |cpf |delivery_confirmed|
+--------+-----+-------+-------------------+-------------------+-----+--------------+------------------+
|C1000 |F1000|S1000 |2019-12-16T13:59:58|2019-12-16T14:00:01|maria|305.584.960-40|sim |
|C1000 |F1000|S2000 |2019-12-16T13:59:59|2019-12-16T14:00:00|joao |733.600.420-26|não |
+--------+-----+-------+-------------------+-------------------+-----+--------------+------------------+
我正在互联网上搜索,但很难找到解决此案例的方法。
【问题讨论】:
-
相关:Pyspark: explode json in column to multiple columns 用于 pyspark
标签: python python-3.x pandas pyspark