remove duplicate entries in two different JSON file

0
votes

I have extensive data in many JSON files, but the problem is that they are many duplicate entries and it make lot's of trouble to find them is that any way to remove them with one click

How can I remove duplicate entries from two different JSON files using python?

First File

[
    {
        "client_id": "1343314236",
        "username": "Nandhu_y_z",
        "name": "nadhu Nandhan"
    },
    {
        "client_id": "1725943170",
        "username": "Nodsfne",
        "name": "Konnengal Z"
    },
    {
        "client_id": "1725943170",
        "username": "Nodsfne",
        "name": "Konnengal Z"
    }
]

Second File


[
    {
        "client_id": "1343314236",
        "username": "Na1dhu_y_z",
        "name": "nadhu Nandhan"
    },
    {
        "client_id": "1725943170",
        "username": "Nodsfne",
        "name": "Konnengal Z"
    },
    {
        "client_id": "1725943170",
        "username": "Nodsfne",
        "name": "Konnengal Z"
    }
]
pythonjson