Dedup Icon

Dedup

Java command line utility to removes duplicate lines from text files.

DedupOverview

DeDup is a Java command-line utilty for removing duplicate
lines in text files.

The dedup process compares adjacent lines only. It does not
sort first. The comparison is case sensitive. It removes
adjacent indentical lines. It replaces the original file, so
do a backup first. You can dedup 1 to N files in one
Execution, just put their names on the command line.

DeDup deletes blank lines from both the beginning and end of
the file. It also deletes trailing blanks from each line. It
also cleans up line terminators /r /n /r/n and converts them
all to platform standard. If the file is already deduped,
it does not change the date.

Use it with:

java com.mindprod.dedup.DeDup myfile.txt anotherfile.txt yetanotherfile.txt

or

java -jar dedup.jar myfile.txt anotherfile.txt yetanotherfile.txt

or, if you have the jar association set up, even even

dedup.jar myfile.txt anotherfile.txt yetanotherfile.txt

It can handle a list of files, or an os-expanded wildcard.
It does not -s to process subdirectories or the use of
directory names to process entire directories.

NEW

Fixed some bugs.

DedupInformation

Version
1.5 Build 9383
Date
01.11.11
License
Free
Language
English
File Size
482KB
SubCategory
Operating Systems
Windows Vista, 2003, XP, 2000, 98, Me, NT
System Requirements
No additional system requirements.
Replicator Icon
The Replicator lets you distribute large numbers of files to many people.
Free
CanadianTax Icon
Calculates Canadian sales taxes: GST HST and PST today or in the past.
Free
CurrCon Icon
CurrCon displays prices in HTML in users' home currency.
Free
FourTidy Icon
Tidies Take Command/TCC/4NT/4DOS DESCRIBE file descriptors
Free
Untouch Icon
Reverts files dates back if the files have not really changed.
Free
BlOut Icon
Blout removes extra blank lines from a file.
Free
Pluck Icon
Scans multiple files looking for a REGEX pattern, and summarised what it finds.
Free
JarCheck Icon
Check that class target versions are as expected in a Java jar.
Free
More
Vistanita Duplicate Finder Icon
Find True Duplicate Files, Duplicate MP3 and Duplicate Pictures / photos.
Trial
Paragon Partition Manager Personal (32-bit) Icon
This easy-to-use partitioning tool is ideal for re-structuring your hard disk
Demo
Ava Find Icon
Find any file on your computer instantly.
Free
Fix My Disk Icon
Recover data from corrupted FAT and NTFS partitions with a step-by-step wiard
Trial
Partition Find and Mount Icon
Partition Find and Mount: Painless Partition Recovery
Free
SanDisk RescuePRO Deluxe Icon
Recover your data from SSD drives.
Demo
WinMend Folder Hidden Icon
Quickly hide files and folders in local partitions and removable devices.
Free
M Exe Editor Icon
edit executable files.This program need microsoft .net framework 3 to run.
Trial
More