Signing back into the Community for the first time? You'll need to reset your password to access your account.  Find out more.

Forum Discussion

Former Member's avatar
Former Member
4 years ago

Tool for detecting and removing duplicates? [Available in 8.10.18]

View Approved Answer

I have several logins that somehow have been duplicated in 1Password 8. This may have happened in different times when I've attempted to migrate my 1Password 7 data to my 1Password.com account.

In any case, I have a load of duplicates in 1Password 8 and it would be very helpful if there were an efficient tool or feature to help me merge/dedupe these entries (and ideally test them to make sure that I'm preserving the correct credentials).

Any thoughts/ideas for how to handle this situation?


1Password Version: 1Password for Mac 8.5.0 80500017, on BETA channel
Extension Version: 2.1.4
OS Version: macOS 12.0.1 (21A559)

View Approved Answer

  • Former Member's avatar
    Former Member

    @ag_ana man, that would be useful if that were the case, but with my dupes, that isn't the case.

    To spinoza's point: "we who merged standalone vaults into the subscription service in when upgrading are the most severely affected."

    This is exactly right. I feel like I was punished for trying to migrate to the new subscription model β€” and now I'm stuck in a situation that seems I can't recover from.

  • Former Member's avatar
    Former Member

    spinoza:

    Just fyi, when I imported my stand-alone vaults I wound up with several thousand duplicates, and no way to remove them except one-by-one.

    Make sure you take a look at the list of tags in the 1Password app: every round of import you performed should have been assigned a specific tag with the import date, so you can select all duplicates at once.

  • spinoza's avatar
    spinoza
    Dedicated Contributor

    Just fyi, when I imported my stand-alone vaults I wound up with several thousand duplicates, and no way to remove them except one-by-one. There was no warning at the time that duplicates would not be merged, with no ability to dedupe.

  • spinoza's avatar
    spinoza
    Dedicated Contributor

    Ben, if you bring back the duplicate cleanup tool that was in version 7, and provide the option to ignore some of the insignificant metadata, that would be very helpful. As you point out, the tool in version 7 was unnecessarily conservative. Since providing that in version 8 may require recoding, even if you simply add that ability into version 7, or as a separate tool available from Cust Service, it would be really helpful.
    I think we who merged standalone vaults into the subscription service in when upgrading are the most severely affected.

    Thanks.

  • Tertius's avatar
    Tertius
    Super Contributor

    Ability to sort or group by password would help with simple duplicate detection, since duplicate entries have duplicate passwords, so it would put duplicates next to each other, where I would be able to decide which entry is kept and which can be dropped. Sort by title is meaningless, because different (but duplicate) sources have different definition of what is a title (for some it's the url, for some it's the website, for some it's free text).

    Sort or group by (first listed) url could also help with duplicate detection, since most entries will have only one url, but there is no possibility to sort by url.

    In v7, searching for duplicates was a chore. In v8 it seems you can use the Watchtower/reused passwords view to group entries with identical passwords, but since I have cleaned up my database before using v8, I cannot say how this actually will work out.

  • 1P_Ben's avatar
    1P_Ben
    Icon for 1Password Team rank1Password Team

    Hey folks,

    I don't think it is a refusal to address the problem, though I understand how having not come up with a better solution can appear to be and I suppose in some ways is effectively a refusal. The issue isn't so much that we wouldn't like to build a robust duplicate detection and clean up system, it is that we recognize doing so would be a heavy lift to do right, and other tasks & features have taken priority. We did actually build a duplicate cleanup tool into 1Password 7 for Mac, but it was incredibly conservative in what it considered to be a duplicate and as such wasn't super helpful in many cases.

    I wish I could promise that a great solution is coming, but I'm not in a position to do that. What I can say is that I'll continue to advocate for one, and I'll also take this opportunity to make sure our product team is aware of the level of demand for such a feature.

    Ben

  • spinoza's avatar
    spinoza
    Dedicated Contributor

    1Password has had this problem for many years, dating back to 1Password 6, and they refuse to fix it. A search of the forums will show a lot of history. Plus I have years of begging them to fix it.

  • Former Member's avatar
    Former Member

    Oy, man that sucks. I literally have thousands of items and hundreds of dupes. I definitely need a more automated way to get my account back into a usable place. πŸ˜“

    Yes, please do add my request to your internal discussion. Thanks!

  • 1P_PeterG's avatar
    1P_PeterG
    Icon for Community Manager rankCommunity Manager

    Hi @"Chris Messina",

    Thanks for this question - it's one, as a person who somehow ends up with multiple copies of everything, that is near to my heart.

    Duplicates in 1Password 8 for Mac will, for now, need to be done manually. You can do this by sorting items by Title (you can find this option at the top of your item list, by clicking the downward-pointing arrow).

    You can then remove duplicates by selecting the desired item (or Ctrl + click to select multiple items). Then, right click one of the selected items and choose Delete.

    I should say that we have heard from customers that a duplicate detective πŸ•΅οΈβ€β™€οΈ feature would be helpful in 1Password 8 for situations like this (I agree!), and hear your request for it here as well. I'm happy to add your request to our internal discussion around that issue. We're always interested in making the app better, and we act on customer feedback often. πŸ™‚

    Thanks for letting us know how this could help for you. I'll pass it along!

    ref: dev/projects/customer-feature-requests/#422