| View previous topic :: View next topic |
| Author |
Message |
QuestionMan
Guest
|
 Posted: Mon Jul 07, 2008 3:27 am Post subject: Need help removing dup. entries :) |
 |
|
Hello, I have a text file with about 100,000 or so entries, like
ABCENTRY100
ABCENTRY102
ABCENTRY104
...
...
Just a string with letters and numbers.
They are comma delimited, but could be re-paged to a line by line.
Could someone please show a way to remove duplicate entries? Even if it is very slow, I can accept that if it can work. Can someone please help me with a process?  |
|
| Back to top |
|
 |
evan
Guest
|
| Posted: Mon Jul 07, 2008 4:03 am Post subject: |
|
|
| look for "sort" with option "U" |
|
| Back to top |
|
|
QuestionMan
Guest
|
| Posted: Mon Jul 07, 2008 12:05 pm Post subject: |
|
|
| Can that work onv ery large lists? |
|
| Back to top |
|
|
HugoV
Joined: 27 May 2007
Posts: 495
|
| Posted: Mon Jul 07, 2008 12:36 pm Post subject: |
|
|
Try it and you'll ind out  (yes it will I've tried with 55 mb files without any problems, might depend on your PC though) |
|
| Back to top |
|
|
vahju
Joined: 17 Feb 2008
Posts: 58
|
| Posted: Mon Jul 07, 2008 3:59 pm Post subject: |
|
|
| You could also try opening this in excel and use the advanced filter to only give you unique values. You can then copy and paste that into another sheet for rework. |
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Register
Profile
Log in to check your private messages
Log in
