Tuesday, July 1, 2014

ChecksumException in HDFS


Came across this exception a couple of times.

/mnt/softwares/hadoop/bin/hadoop fs -copyFromLocal /mnt/folder1/folder2/file.tsv /mnt/folder1/folder2/file.tsv
14/07/01 09:47:58 INFO fs.FSInputChecker: Found checksum error: b[0, 0]=
org.apache.hadoop.fs.ChecksumException: Checksum error: /mnt/folder1/folder2/file.tsv at 0
        at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:219)
        at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:237)
        at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:189)
        at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
        at java.io.DataInputStream.read(DataInputStream.java:83)
        at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:68)
        at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:47)
        at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:100)
        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:230)
        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:176)
        at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1209)
        at org.apache.hadoop.fs.FsShell.copyFromLocal(FsShell.java:138)
        at org.apache.hadoop.fs.FsShell.run(FsShell.java:1950)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.fs.FsShell.main(FsShell.java:2090)
copyFromLocal: Checksum error: /mnt/folder1/folder2/file.tsv at 0

Seems like it is a bug reported into hadoop

Simple solution: Remove the crc file from the folder from where you are copying the file.

Cheers.

74 comments :

angela michael said...

horizon security services inc I would like to thank you for your nicely written post, its informative and your writing style encouraged me to read it till end. Thanks

Rasool Bevi said...

The expansion of internet and intelligence in business process lead the way to huge volume of data. It is important to maintain and process these data to be efficient in data handling.
Hadoop Training in Chennai

geethu said...

Updating with the latest technology and implementing it is the only way to survive in our niche. Thanks for making me this article. You have done a great job by sharing this content in here. Keep writing article like this.
SAS Training in Chennai | SAS Course in Chennai

Mark Smith said...

Rolex Watches Authentic Mens & Ladies Rolex Datejust, President Watches for Sale at JavyEstrella.com.

efloral Gift said...

online birthday flowers delivery eFloralgifts is one of the premier floral and gifting retailer, offering gifts for all occasions like Birthdays, Anniversaries , Thank you , Weddings, Sympathy and many others.

jyoti roy said...

Thank you for sharing such a wonderful post. Keep rocking!! CCNA Training Institute in Chennai | CCNP Training Institute in Chennai.

karuma said...

Thanks for your great information..keep updating...
MCSE Certification Exam Center in Chennai | MCSE Certification Training in Chennai | MCSE Exam Center in Chennai | MCSE Training Institute in Chennai

sivanesan said...

The best thing is that your blog really informative thanks for your great information!
erp in chennai

anitha a said...

stuff The best thing is that your blog really informative thanks for your great information!
Web designing course in chennai

vini vinitha said...

I have read this blog, it is interesting and informative.thanks for sharing...
campus events | college paper presentaion

prabash said...

Excellent and useful post. Thanks for taking a time to share Web Designing Training Institute in Chennai | Web Designing Training Institute in Velachery

devo said...

Good post.Thank you for sharing such a wonderful blog...Dot Net Training Institute in Chennai | Dot Net Training Institute in Velachery

srihariparu said...

This was so useful and informative. The article helped me to learn something new.
Six Sigma Certification Training in Chennai | No.1 Six Sigma Certification Exam Center in Chennai

deepti said...

Excellent post! Thank you for Sharing..Android Training Institute in Chennai | Android Training Institute in Velachery

rupiya rupi said...

Thanks for sharing this unique and informative content..keep updating..
Dot Net Training in Chennai | No.1 Dot Net Training Institute in Chennai | Best Dot Net Training Center in Chennai

nancy said...

Really an amazing post..! By reading your blog post i gained more information.
Final Year Project Center in Chennai | IEEE Project Center in Chennai | Diploma Project Center in Chennai

ASO Services said...

Thanks for your marvelous posting! It is very useful and good. Come on. I want to introduce the best aso services for you, I try it and I feel it is so good to rank app to top in app store search results, have you ever heard it?

JamesWilliam said...
This comment has been removed by the author.
JamesWilliam said...

Informative blog and it was up to the point describing the information very effectively. Thanks to blog author for wonderful and informative post. Also great with all of the valuable information on mobile app and you are doing well.
Mobile application developers in Chennai | Android application developers in Chennai

JamesWilliam said...


Interesting post! This is really helpful for me. I like it! Thanks for sharing!
PHP developers Chennai | PHP developers in Chennai

PLC Training in Chennai said...

thanks for sharing

PLC Training Chennai said...

Thanks a lot for providing this with us. Keep on updating this with us regularly...


PLC Training in Chennai | PLC Training Institute in Chennai | PLC Training Center in Chennai | PLC SCADA Training in Chennai | Best PLC Training in Chennai | Best PLC Training Institute in Chennai | PLC Training in Kerala | AutoCAD Training in Chennai | Embedded Systems Training in Chennai | VLSI Training in Chennai | Inplant Training in Chennai

JamesWilliam said...

Informative blog and it was up to the point describing the information very effectively. Thanks to blog author for wonderful and informative post. Also great with all of the
valuable information on mobile app and you are doing well.
Mobile application developers in Chennai | Android application developers in Chennai | Android app developers Chennai

Barath BK said...

It’s nice post of getting strongest link from Google Plus, i will share it to my seo circle. Keep updated.
CorelDraw Training Institute in Chennai | CorelDraw Training Institute in Velachery

sherin angel said...

Yet another excellent post! I will be bookmarking your blog. I shared it on a few social media sites :) Thanks for sharing! Keep these great articles coming!
MCA Project Center in Chennai | MCA Project Center in Velachery

DAVIS MILLER said...

I wish to show thanks to you just for bailing me out of this particular
trouble.As a result of checking through the net and meeting
techniques that were not productive, I thought my life was done.

java training in chennai

Gowri S said...

Expected to form you a next to no word to thank you once more with respect to the decent recommendations you've contributed here.Big Data Training in Marathahalli

Embedded training in chennai said...

Nice post... thank for sharing..its really interesting..

PLC training institute in chennai | Embedded training in Chennai

praveen said...

Articles that you have provided contains a very interesting useful information....VLSI Project Center in Chennai | VLSI Project Center in Velachery

devo said...

Very good and informative article. Thanks for sharing such nice article, keep on updating..
Best Microsoft Azure Training Institute in Chennai | Best Microsoft Azure Training Institute in Velachery

Barath BK said...

There was very wonderful information and that's great one. I really appreciate the kind words, thanks for sharing that valuable information.
Best Graphics Designing Training Institute in Chennai | No.1 Graphics Designing Training Institute in Velachery

karthik said...


Nice post.I am really enjoying reading your well written articles. thanks for sharing..keep on updating..
Best VMware Training Institute in Chennai | Best VMware Training Institute in Velachery

muthu said...

This is a great stuff and keeps on sharing a more informative post like this.
Best Adobe Photoshop Training Institute in Chennai | No.1 Photoshop Training Institute in Chennai

Sarath K said...

Very inspiring article for us Thanks for the great article. …. It’s definitely a good idea for me and my friends to learn the things that’ll expand their skill set your ideas and presentation is very effective and useful for all. I am loving all of the in turn you are sharing with each one…
Best CorelDraw Training Institute in Chennai | No.1 Photoshop Training Institute in Chennai

kalai hai said...

Thanks for sharing this information and keep updating us. This information is very useful to me.
Best Graphics Designing Training Institute in Chennai | No.1 CorelDraw Training Institute in Chennai| Excellent Photoshop Training Institute in Velachery

Jahan Murugassan said...

There was very wonderful information and that's great one. I really appreciate the kind words, thanks for sharing that valuable information.

white label website builder

JamesWilliam said...


Thanks for sharing this niche useful informative post to our knowledge.
brochure designers in chennai | brochure design company in chennai

deepika ranjith said...

Excellent post! Thank you for Sharing.

Apache Spark Training in Chennai
| Apache Spark Online Training

Anoushka Sakthi said...

Energetic blog with loads and loads of info. Keep doing more.


Selenium training in Chennai
Selenium Courses in Chennai
best ios training in chennai
Digital Marketing Training in Chennai
JAVA J2EE Training Institutes in Chennai
Loadrunner course in Chennai
Qtp training institutes in chennai

Karthik said...

The blog gives more information about the training and career, its useful to enhance my skills and knowledge
Qtp training in Chennai
Qtp training
Qtp training institutes in chennai
Qtp training Chennai
Qtp course in Chennai

brindhaajay said...

Simply superb about this blog. Really a great job. Good information for the freshers.
Seeking for this kind of information and got it thank you for the post.
best institute for java
best java training
java programming certification course
best java certification
best java training
best java training institutes

yuvanthi said...

Very interesting content which helps me to get the indepth knowledge about the technology. To know more detils about the course visit this website.
Qtp training in Chennai
JAVA Training in Chennai
core Java training in chennai
Best JAVA Training in Chennai

yuvanthi said...
This comment has been removed by the author.
sudhagar said...

I feel satisfied to read your blog, you have been delivering a useful & unique information to our vision.keep blogging.
Regards,
Digital Marketing Training in Chennai
Digital Marketing Course in Chennai
RPA Training in Chennai
Ethical Hacking Course in Chennai
Blue Prism Training in Chennai
Digital Marketing Training in Porur
Digital Marketing Training in Velachery

Unknown said...

Make a lot of money with online casino BGAOC we have top rated online casinos If you want to always be in the money, then try to play online casino with us.

sathyaramesh said...

I wondered upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.
Web Designing Course in chennai
Web Designing training in chennai
Angularjs Training in Chennai
Selenium Training in Chennai
German Classes in Chennai
Web designing Training in Velachery
Web designing Training in Tambaram

Joe said...

Extra-Ordinary piece of work. Interesting concepts to read. Very much informative. Thanks for sharing. Waiting for your future posts.
Tableau Training in Chennai
Tableau Course in Chennai
Tableau Training Institutes in Chennai
Tableau Training in Tambaram
Spoken English Classes in Chennai
Best Spoken English Classes in Chennai
SAS Training in Chennai
SAS Course in Chennai

Manisha singh said...

Thanks a lot for providing this with us. Keep on updating.
CCNA Training in Delhi

CCNA Course in Delhi

CCNA Training institute in Delhi

Maria said...

Yesterday I came to visit my sister and we decided to have fun and play online casinos, polazili on a bunch of sites and this one caught my eye unforgettable gambling statistics Here we quickly figured out what was happening and began to think quickly about the strategy. and we found her now we take money out of here every day

Vicky Ram said...

Awesome post. Really you are shared very informative concept... Thank you for sharing. Keep on
updating...

linuxhacks
Education

Anbarasan14 said...

Excellent Blog!!! Such an interesting blog with a clear vision, this will definitely help many to make them update.
Spoken English Classes in Coimbatore
Spoken English Class in Coimbatore
Spoken English Training in Coimbatore
Spoken English Coimbatore
Spoken English Classes in Chennai
Spoken English Class in Chennai
Spoken English in Chennai

Aravind said...


Thanks for sharing this blog with us. I really enjoy reading your post. Keep Doing.
Blue Prism Training in Chennai
Blue Prism Training Chennai
SEO Course in Chennai
RPA Classes in Chennai
CCNA Training in Chennai
Blue Prism Training in Adyar
Blue Prism Training in Tambaram

abhi pranesh said...

Thanks for posting this article it has really a good content.
Spoken English Classes in Chennai
Spoken English in Chennai
Japanese Classes in Chennai
French Classes in Chennai
pearson vue
German Classes in Chennai
Spoken English Classes in Adyar
Spoken English Classes in Velachery

Vinoth Kumar said...

VLSI Training in Chennai | VLSI Training in Anna Nagar | VLSI Training Institute in Anna Nagar | VLSI Training Institute in Chennai | VLSI Training Institutes in Chennai | Best VLSI Training in Chennai | Best VLSI Training Institute in Chennai | VLSI Course in Chennai | VLSI Training Course in Chennai | VLSI Training Institutes in Chennai | Best VLSI Training Institutes in Chennai

cynthia williams said...

Awesome post with lots of data and I have bookmarked this page for my reference. Share more ideas frequently.
Blue Prism Training in Chennai
Blue Prism Training Institute in Chennai
RPA Training in Chennai
RPA course in Chennai
RPA Training Institute in Chennai
UiPath Training in Chennai
RPA Training in Tambaram
Blue Prism Training Chennai

divyapriya said...

A good blog for the people who really needs information about this.
Good work keep it up.
TOEFL Coaching in Chennai
TOEFL Classes in Chennai
German Classes in Chennai
IELTS Coaching in Chennai
Japanese Classes in Chennai
spanish language in chennai
TOEFL Coaching in OMR
TOEFL Coaching in Porur

Raju said...

Such a great article which i read before, it's a valuable suggestion to do in the process we can do.
SEO training in chennai
SEO course in chennai
Digital marketing training in chennai

Karthik said...

I have read your article recently, its very informative and nice to read about the course which you mentioned
SEO training in chennai
SEO course in chennai
SEO classes in t nagar
SEO training in velachery
SEO training in anna nagar

Karthik said...

Such a great article which i read before, it's a valuable suggestion to do in the process we can do.
ccna course in chennai
ccna training in chennai
Python Course in Chennai
Python Training in Velachery
ccna training in anna nagar
ccna course in T Nagar
ccna training in porur

Karthik said...

I have read your article recently, its very informative and nice to read about the course which you mentioned
CCNA course in chennai
CCNA training in chennai
CCNA training in anna nagar
CCNA training in porur
Python Training in Chennai
CCNA training in T Nagar
CCNA classes in tambaram
CCNA training in Omr
Python Training in Velachery

Raju said...

Thanks for your post which gather more knowledge about the topic. I read your blog everything is helpful and effective.
German Classes in Chennai
German Language Course in Chennai
German Language Classes in Chennai
German Courses in Chennai
German classes in Anna Nagar
German classes in Velachery
German classes in Tambaram
German classes in Adyar

Unknown said...

I have read your article recently, its very informative and nice to read about the course which you mentioned
Java Training in Chennai
Java Course in Chennai
Java Training in Anna Nagar
Java Training in Velachery
Java Training in Tambaram
Python Training in Chennai
Python Training in Anna nagar
Python Training in OMR

Raju said...


I gathered many useful informations about this topic. Really very useful for learning the skills and will continue your blog reading in the future.
Big data analytics training in T nagar
Big data analytics training in Porur
Hadoop training in Velachery
Hadoop training in Adyar
Hadoop training in OMR
Hadoop training in chennai
Big data analytics training in Adyar
Big data training in chennai

Vicky Ram said...

It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...

Technology
payrollmanagementservice

nikitha josh said...

This is really impressive post, I am inspired with your post, do post more blogs like this, I am waiting for your blogs.
aviation training in Chennai
air hostess academy in Chennai
Airport Management Training in Chennai
airport ground staff training courses in Chennai
Aviation Academy in Chennai
air hostess training in Chennai
airport management courses in Chennai
ground staff training in Chennai

sheela rajesh said...

Thanks for providing such great and useful informations on your blog.update more data later.
Hadoop Training in Chennai
Big data training in chennai
Big Data Hadoop Training in Chennai
JAVA Training in Chennai
Python Training in Chennai
IOS Training in Chennai
Hadoop training in chennai
Big data training in chennai
big data training in chennai anna nagar

Senthil said...

I gathered many useful informations about this topic. Really very useful for learning the skills and will continue your blog reading in the future.
Blue Prism Training in Anna nagar
Blue Prism Training in Chennai
Blue Prism training chennai
RPA Training in Anna nagar
RPA Training in Adyar
Data Science course in Anna nagar

jenifer irene said...

Excellent post gained so much of information, Keep posting like this.
Aviation Courses in Chennai
Air hostess training in Chennai
Airline Courses in Chennai
airport ground staff training courses in Chennai
Aviation Academy in Chennai
air hostess training in Chennai
airport management courses in Chennai
ground staff training in Chennai

kokilaswe said...

very nice blogs!!! i have to learning for lot of information for this sites...Sharing for wonderful information. Thanks for sharing this valuable information to our vision. You have posted a trust worthy blog keep sharing

Best AWS Training Academy in Kanchipuram

thenujo said...

Really very great information to be provided and the All points discussed were worth reading and i’ll surely work with them all one by one.
Best C and C++ Programming Training Academy in Kanchipuram

sankarisri said...

Awesome post. Really you are shared very informative concept... Thank you for sharing. Keep on updating...

Best Graphics Designing Training Academy in Kanchipuram

sumathi said...

Thanks for this greatful information. all this information is very important to all the users and can be used good at all this process
Best Tally ERP 9.0 Training Academy in Kanchipuram

sumathi said...

Thanks for this greatful information. all this information is very important to all the users and can be used good at all this process
Best Tally ERP 9.0 Training Academy in Kanchipuram

Aparna said...

Excellent post and I really glad to saw your worthful post. I am waiting for your next post and keep updating unique details in this topic.
Spark Training in Chennai
Spark Training Academy
Power BI Training in Chennai
Tableau Training in Chennai
Oracle Training in Chennai
Oracle DBA Training in Chennai
Spark Training in Valachery
Linux Training in Chennai
Unix Training in Chennai