java - choosing language to work on very large text files (up to some terabytes) -



java - choosing language to work on very large text files (up to some terabytes) -

i working on project uses text files (.txt) input, reading them line line files can go big 1 terabytes. know languages/technologies used similar problems, java, bash, awk, , python. don't know 1 can work such big file, , kind on tricks , tweaks needed.

as long process file line line , assemble statistics, doesn't matter tool choose.

java has advantage in terms of speed, compared scripting languages, in end difference constant factor. matters algorithm utilize process file.

java python bash awk

-

Comments

Post a Comment

Popular posts from this blog

maven fortify plugin : Unable to load build session with ID XXXXX .. See log file for more details -

maven fortify plugin : Unable to load build session with ID XXXXX .. See log file for more details - i took refrence : generating fortify study in maven but invoking : mvn sca:scan throws below error : unable load build session id xxxxx .. see log file more details. [error] error invoking sourceanalyzer. exit code: 1. verify project settings , sca installation. i tried looking around various posts , no luck. could please advise. directly running "mvn sca:scan" not work. next needs executed before "mvn sca:scan"" mvn sca:translate plugins fortify sca
Read more

c# - Primavera WebServices does not return any data -

c# - Primavera WebServices does not return any data - i using primavera webservices (version 6.2.1) read info primavera database (sqlserver 2008r2) in winform application (c#). utilize http cookie container authentication mode. before moved database new server able login , read info primavera database when moved db (using backup , restore), can still login db primavera webservices homecoming null request. this code login: authenticationservice authservice = new authenticationservice( ); authservice.cookiecontainer = new system.net.cookiecontainer( ); authservice.url = _p6wsauthenticationservice; login loginobj = new login( ); loginobj.username = pv_username; loginobj.password = pv_password; loginobj.databaseinstanceid = 1; loginobj.databaseinstanceidspecified = true; loginobj.verbosefaults = true; loginobj.verbosefaultsspecified = true; loginresponse loginreturn = authservice.login( loginobj ); readdatabaseinstancesresponsedatabaseinstance[] rea...
Read more

android - Display emoji panel with genymotion - keyboard/touch input? -

android - Display emoji panel with genymotion - keyboard/touch input? - i seek no luck open panel emoji icons cannot find if possible on genymotion (?) input keyboard. regards go settings->language , input->current keyboard turn on "show input method" switch. this cause keyboard appear on screen when input text, way android works on device doesn't have hardware keyboard. can utilize input emoji. if there's improve way, or way, don't know it. android android-emulator avd genymotion emoji
Read more