Miscellaneous Utilities
"Miscellaneous Utilities" (Misc. Utilities) contains several tools for working with text files.
Extract Usernames
Extract Usernames — extract usernames from email addresses (the part before the @ symbol).
Extract Domains
Extract Domains — extract domains from email addresses (the part after the @ symbol).
Extract Fields
Extract Fields — extract columns. Enter the column numbers separated by commas, for example 1,2,3. Column separators can be either commas or tab characters.
Extract Lines with N or More Fields
Extract Lines with N or more fields — specify the number of columns N (from 1 to 40).
Replace CR and LF by CRLF, CR and CRLF by LF, LF and CRLF by CR
CR and LF are control characters used to mark the end of lines in text files. CR stands for Carriage Return. LF stands for Line Feed. In Windows, the standard line ending is a two-character sequence (CRLF = CR+LF). In Unix-based systems (Linux, macOS, etc.), a single LF character is used. Sometimes text files with CR-only line endings are also encountered.
The utility "Replace CR and LF by CRLF" converts a text file into the Windows-standard CRLF line ending format.
Similarly, "Replace CR and CRLF by LF" sets the line ending to LF, and "Replace LF and CRLF by CR" sets it to CR.
Add a String to the Beginning
The "Add specified prefix to the beginning" utility inserts the specified string ("prefix") at the beginning of each line in the input file. If the "Modify Fields" option is enabled, the prefix will be inserted at the beginning of each specified column (column numbers are entered separated by commas).
Add a String to the End
The "Add specified extension to the end" utility is similar to the previous one, but appends the specified string to the end of each line or column in the file.
Replace
This utility allows replacing text, blank fields, or character sequences defined by a regular expression (regex) with a specified string. Similar to the previous two utilities, either entire lines or only specified fields are modified (Modify Fields). The replacement string may contain special escape sequences and macros:
^t— tab character.^r— carriage return (CR).^n— line feed (LF).^p—CR+LF.^^— the^character.{%RND(<range>)%}— a random integer.<range>specifies the value range from 0 torange-1. Example:{%RND(10)%}
Calculate Hash
The "Calculate Hash" utility can generate the following hash types: MD5, SHA1, SHA256, SHA512. If the "Multi Column Support" option is enabled, the hash is calculated from the email column; otherwise, it is calculated from the entire line.
The Salt setting allows computing a "salted" hash using the following algorithm:
value = HASH(salt + email)
The result (hash) is output in hexadecimal (HEX) format. You can optionally prepend the 0x prefix, for example: 0x6e068a501239876c1cdc403b2f698187.
You can also choose the output format:
hash— output only the hash value.email,hash— output the email and the hash (comma-separated).source_line,hash— output the original line and the hash (comma-separated).
Output File Sorting
You can enable sorting of the output file (Sort). Sorting settings:
- Remove Duplicates.
- Sort By Domain.
Output to the Input File
The "Output File: Same As Input" setting allows overwriting the source files.