hadoop - Apache Pig Error -- Unable to trace -



hadoop - Apache Pig Error -- Unable to trace -

when seek run below pig query, getting error while using sort command. if omit sort transform, query able execute.

grunt> month1 = load 'hdfs://localhost.localdomain:8020/user/cloudera/data/big1/climate_month1.txt' using pigstorage(','); grunt> month2 = load 'hdfs://localhost.localdomain:8020/user/cloudera/data/big1/climate_month2.txt' using pigstorage(','); grunt> month3 = load 'hdfs://localhost.localdomain:8020/user/cloudera/data/big1/climate_month3.txt' using pigstorage(','); grunt> month4 = load 'hdfs://localhost.localdomain:8020/user/cloudera/data/big1/climate_month4.txt' using pigstorage(','); grunt> month5 = load 'hdfs://localhost.localdomain:8020/user/cloudera/data/big1/climate_month5.txt' using pigstorage(','); grunt> months = union month1, month2, month3, month4, month5; grunt> clearweather = filter months skycondition == 'clr'; grunt> shapedweather = foreach clearweather generate date, substring(date,0,4) year, substring(date,4,6) month, substring(date,6,8) day, skycondition, drytemp; grunt> groupedbymonthday = grouping shapedweather (month, day) parallel 10; grunt> aggedresults = foreach groupedbymonthday generate grouping monthday, avg(shapedweather.drytemp) averagetemp, min(shapedweather.drytemp) minimumtemp, max(shapedweather.drytemp) maximumtemp, count(shapedweather.drytemp) counttemp parallel 10; grunt> sortedresult = sort aggedresults $1 desc; 2014-10-31 10:22:44,664 [main] error org.apache.pig.tools.grunt.grunt - error 1200: <line 11, column 0> syntax error, unexpected symbol @ or near 'sortedresult' details @ logfile: /home/cloudera/pig_1414775884282.log

and error file says: /home/cloudera/pig_1414775884282.log can give me solution this.

pig stack trace --------------- error 1200: <line 11, column 0> syntax error, unexpected symbol @ or near 'sortedresult' failed parse: <line 11, column 0> syntax error, unexpected symbol @ or near 'sortedresult' @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:235) @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:177) @ org.apache.pig.pigserver$graph.validatequery(pigserver.java:1572) @ org.apache.pig.pigserver$graph.registerquery(pigserver.java:1545) @ org.apache.pig.pigserver.registerquery(pigserver.java:518) @ org.apache.pig.tools.grunt.gruntparser.processpig(gruntparser.java:991) @ org.apache.pig.tools.pigscript.parser.pigscriptparser.parse(pigscriptparser.java:412) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:194) @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:170) @ org.apache.pig.tools.grunt.grunt.run(grunt.java:69) @ org.apache.pig.main.run(main.java:538) @ org.apache.pig.main.main(main.java:157) @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:39) @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:25) @ java.lang.reflect.method.invoke(method.java:597) @ org.apache.hadoop.util.runjar.main(runjar.java:208)

no sort command in pig. seek order command

sortedresult = order aggedresults $1 desc;

apache hadoop apache-pig bigdata

-

Comments

Post a Comment

Popular posts from this blog

formatting - SAS SQL Datepart function returning odd values -

formatting - SAS SQL Datepart function returning odd values - i'm having massive problem project can't seem right. i'm trying modify info variable in datetime format. first info 30mar12:00:00:00. i've been advised utilize code below returns value 30mar60:5:30:00. want date component , have no thought how info got exported in format wasn't in microsoft access. i've tried several mods code 1 time again comes blank or sends error message. proc sql; update dataset set date = datepart(date); quit; any advice appreciated. i'm guessing variable date numeric , formatted datetime. 1 time you've carried out conversion, alter format date9. sas datetime value number of seconds since 01 jan 1960, whereas dates number of days since 01 jan 1960. both stored numbers, using right format display value key. illustration below. data _null_; a='30mar12:00:00:00'dt; b=datepart(a); c=b; format b datetime. c date9.; set b c; run; ...
Read more

c++ - Apple Mach-O Linker Error(Duplicate Symbols For Architecture armv7) -

c++ - Apple Mach-O Linker Error(Duplicate Symbols For Architecture armv7) - here error: duplicate symbol _objc_metaclass_$_bfapplinkreturntorefererview in: /users/user/documents/facebooksdk/facebooksdk.framework/facebooksdk(bfapplinkreturntorefererview.o) /users/user/desktop/project/project/project/assets/facebook/editor/ios/facebooksdk/facebooksdk.a(bfapplinkreturntorefererview.o) ld: 889 duplicate symbols architecture armv7 clang: error: linker command failed exit code 1 (use -v see invocation) i have searched find solution of error couldn't. there tons of similar error this, 1 hasn't been asked yet. problem shows when add together "-objc" "other linker flags". need add together utilize admob service. problem? how can solve this? i faced same issue while integrating facebook-ios-sdk. because using 3rd party library had bolts.framework linked against it. solution found incorporate facebook-ios-sdk source code hosted on github. ...
Read more

php - Yii 2: Unable to find a class into the extension 'yii2-admin' -

php - Yii 2: Unable to find a class into the extension 'yii2-admin' - extension's github project: https://github.com/mdmsoft/yii2-admin i'm using advanced template of yii2, i've backend , frontend , common folders advanced folder. the advanced folder on same level of vendor folder. i've others extensions , working then installed yii2-admin composer php composer.phar require mdmsoft/yii2-admin "*" installation worked well. into vendor folder i've mdmsoft folder yii2-admin subfolder it. this actual content of v endor/yiisoft/extensions.php (modified composer installation, haven't manually touched it) <?php $vendordir = dirname(__dir__); homecoming array ( 'yiisoft/yii2-jui' => array ( 'name' => 'yiisoft/yii2-jui', 'version' => '2.0.0.0', 'alias' => array ( '@yii/jui' => $vendordir . '/yiisoft/yii2-jui', ...
Read more