Look for Byte Order Mark (BOM) in files

Search Options	close
Search the following clips: All Clips

news science politics food economy art
technology health internet religion psychology

Sign Up Install Learn More Login


	Look for Byte Order Mark (BOM) in files

sugarsupport

1-17-2009 8:29 PM

107 views

tags:

bom, linux, command

sugarsupport says:

A Recursive function to find files with BOMs in them

Add a Comment

Login to Comment. Not a member yet? Sign up

Today's Top Clips

visit the Top Clips page

View the Top Clips from January 17, 2009

Embed This Clip In Your Site...

<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/df8983fd-b33d-4306-b0a1-6f80034ed87a/B6212BF9-56B1-4AFE-AE80-6C25170CB41C/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom" href="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom" style="font-size: 11px;">stackoverflow.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><PRE class="prettyprint"><CODE><SPAN class="pln">find </SPAN><SPAN class="pun">-</SPAN><SPAN class="pln">type f </SPAN><SPAN class="pun">|</SPAN><SPAN class="pln"><BR /></SPAN><SPAN class="kwd">while</SPAN><SPAN class="pln"> read file<BR /></SPAN><SPAN class="kwd">do</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">if</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">[</SPAN><SPAN class="pln"> </SPAN><SPAN class="str">"`head -c 3 -- "</SPAN><SPAN class="pln">$file</SPAN><SPAN class="str">"`"</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">==</SPAN><SPAN class="pln"> $</SPAN><SPAN class="str">'\xef\xbb\xbf'</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">]</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">then</SPAN><SPAN class="pln"><BR />        echo </SPAN><SPAN class="str">"found BOM in: $file"</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">fi</SPAN><SPAN class="pln"><BR />done</SPAN></CODE></PRE></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><SPAN class="pln">find </SPAN><SPAN class="pun">-</SPAN><SPAN class="pln">type f</SPAN><SPAN class="pun">|</SPAN><SPAN class="kwd">while</SPAN><SPAN class="pln"> read file</SPAN><SPAN class="pun">;</SPAN><SPAN class="kwd">do</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">[</SPAN><SPAN class="pln"> </SPAN><SPAN class="str">"`head -c3 -- "</SPAN><SPAN class="pln">$file</SPAN><SPAN class="str">"`"</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">==</SPAN><SPAN class="pln"> $</SPAN><SPAN class="str">'\xef\xbb\xbf'</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">]</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">&&</SPAN><SPAN class="pln"> echo </SPAN><SPAN class="str">"found BOM in: $file"</SPAN><SPAN class="pun">;</SPAN><SPAN class="pln">done</SPAN></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><DIV id="question-header">
    <H2><A href="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom">Elegant way to search for UTF-8 files with BOM?</A></H2>
</DIV></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><PRE class="prettyprint"><CODE><SPAN class="pln">find </SPAN><SPAN class="pun">-</SPAN><SPAN class="pln">type f </SPAN><SPAN class="pun">|</SPAN><SPAN class="pln"><BR /></SPAN><SPAN class="kwd">while</SPAN><SPAN class="pln"> read file<BR /></SPAN><SPAN class="kwd">do</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">if</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">[</SPAN><SPAN class="pln"> </SPAN><SPAN class="str">"`head -c 3 -- "</SPAN><SPAN class="pln">$file</SPAN><SPAN class="str">"`"</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">==</SPAN><SPAN class="pln"> $</SPAN><SPAN class="str">'\xef\xbb\xbf'</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">]</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">then</SPAN><SPAN class="pln"><BR />        echo </SPAN><SPAN class="str">"found BOM in: $file"</SPAN><SPAN class="pln"><BR />    </SPAN><SPAN class="kwd">fi</SPAN><SPAN class="pln"><BR />done</SPAN></CODE></PRE></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><PRE class="prettyprint"><CODE><SPAN class="pln">find </SPAN><SPAN class="pun">-</SPAN><SPAN class="pln">type f</SPAN><SPAN class="pun">|</SPAN><SPAN class="kwd">while</SPAN><SPAN class="pln"> read file</SPAN><SPAN class="pun">;</SPAN><SPAN class="kwd">do</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">[</SPAN><SPAN class="pln"> </SPAN><SPAN class="str">"`head -c3 -- "</SPAN><SPAN class="pln">$file</SPAN><SPAN class="str">"`"</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">==</SPAN><SPAN class="pln"> $</SPAN><SPAN class="str">'\xef\xbb\xbf'</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">]</SPAN><SPAN class="pln"> </SPAN><SPAN class="pun">&&</SPAN><SPAN class="pln"> echo </SPAN><SPAN class="str">"found BOM in: $file"</SPAN><SPAN class="pun">;</SPAN><SPAN class="pln">done</SPAN></CODE></PRE></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><P>For debugging purposes, I need to recursively search a directory for all files which start with a UTF-8 byte order mark (BOM). My current solution is a simple shell script:</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><P>Or, if you prefer short, unreadable one-liners:</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><P>It doesn't work with filenames that contain a line break,
but such files are not to be expected anyway.</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><P>Is there any shorter or more elegant solution?</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/204765/elegant-way-to-search-for-utf-8-files-with-bom"><P>Are there any interesting text editors or macros for text editors?</P></blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;">&nbsp;</td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/B6212BF9-56B1-4AFE-AE80-6C25170CB41C/blog/" title="blog or email this clip"><img src="http://content7.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>

New from the makers of Clipmarks: Amplify.com - Don't just share the news...Amplify it!

Clipmarks: Home; New Clips; Top Clips; Dashboard

Popular Topics: News; Life; Science; Technology; Entertainment

Get Started: Sign Up; Install Clipping Tool; How Clipping Works; Clip-to-Blog™; ClipSearch

Tools and Resources: FAQ; ClipWeek; Top Clippers; Top Tags; Site Map

About Clipmarks: About Us; Contact; Copyright; Privacy; EULA

Search Options

Today's Top Clips