Pages

Monday, January 24, 2011

Very large text file and vi Editor

Once I entered to the world of high scalable computing it became common to handle file larger than 2 Gb. Usually files are more than the amount of ram a computer has. for e.g the English Wikipedia dump is around 9 Gb with 3,500,000 articles. The whole Wikipedia seems to be around 29 Gb. The whole file could not be open in common windows editors like notepad or NotePad++.


LTFViewer is a decent option in windows to open very large files and probably it loads one page at a time into memory.

I went back to VI editor in Linux .Here goes some useful commands.

To switch from Insert Mode to Command Mode, press the Escape (Esc) key.

http://www.sharpened.net/resources/commands/vi

Let me know via comment or email if you know any other software in windows which can open very huge text files.