如果行在python中重复，则删除所有行答案

【问题标题】：remove all row if the row is duplicate in python如果行在python中重复，则删除所有行
【发布时间】：2021-04-14 05:08:15
【问题描述】：

我尝试删除重复的行，但收到错误代码：'Series' object has no attribute 'remove'。

我可以知道如何替换“删除”命令或修复属性错误吗？

如果该行在 allMYemail.csv 中重复，则必须删除该行。有我的代码：

import csv
import re
import json
import pandas as pd

df1 = pd.read_csv('allMYemail.csv')
df2 = pd.read_csv('MYallmatchagain.csv')

emailSet = set()
for i, row in df1.dropna().iterrows():
    emailSet.add(row['0'])
# print(emailSet)
output = []
for i,row in df2.iterrows():
    # print(row)
    Birthdate = row['Birthdate']
    Gender = row['Gender']
    Mobile2 = row['Mobile2']
    Salutation = row['Salutation']
    email = row['email']
    firstName = row['firstName']
    lastName = row['lastName']
    name = row['name']
    areaCode = row['areaCode']
    errorCode = row['errorCode']
    localNumber = row['localNumber']
    Status = row['Status']
    Domain = row['Domain']
    ReturnCode = row['ReturnCode']
    matched = False
    for emails in emailSet:
        if emails == email:
            matched = True
            break
    if matched:
        row.remove('Birthdate')
        row.remove('Gender')
        row.remove('Mobile2')
        row.remove('Salutation')
        row.remove('email')
        row.remove('firstName')
        row.remove('lastName')
        row.remove('name')
        row.remove('areaCode')
        row.remove('errorCode')
        row.remove('localNumber')
        row.remove('Status')
        row.remove('Domain')
        row.remove('ReturnCode')
    else:
        pass
    output_obj = {}
    output_obj['Birthdate'] = Birthdate 
    output_obj['Gender'] = Gender
    output_obj['Mobile2'] = Mobile2 
    output_obj['Salutation'] = Salutation 
    output_obj['email'] = email 
    output_obj['firstName'] = firstName 
    output_obj['lastName'] = lastName 
    output_obj['name'] = name
    output_obj['areaCode'] = areaCode
    output_obj['errorCode'] = errorCode 
    output_obj['localNumber'] = localNumber 
    output_obj['Status'] = Status 
    output_obj['Domain'] = Domain
    output_obj['ReturnCode'] = ReturnCode 
    output.append(output_obj)
df = pd.read_json(json.dumps(output))
# print(json.dumps(output))
df.to_csv(r'MYfinish.csv', index = None)

非常感谢任何帮助。

【问题讨论】：

标签： python pandas dataframe csv

【解决方案1】：

由于您的问题不清楚它想要做什么，如果您只想在一个 df 中删除完全重复的行，那么 @Renaud 的解决方案将完成这项工作。如果您想根据单列“电子邮件”中的重复项删除行，请尝试以下操作：

def firstline(d):
   return(d.reset_index(drop=True).loc[0])

result_df = df.groupby('email').apply(firstline)

【讨论】：

谢谢。是的，我想根据单列 'email' 中的重复项删除行。

【解决方案2】：

你尝试过 pandas 的 drop_duplicates() 吗？

https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.drop_duplicates.html

df.drop_duplicates(inplace=True)

【讨论】：