Comments on: A Better diff Or What To Do When GNU diff Runs Out Of Memory ("diff: memory exhausted") http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/ where things have nothing to do with beer - tutorials, tips, how-tos, thoughts, hacks, and other techy nonsense Sat, 19 May 2012 21:39:38 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: Michael Andersonhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52517 Michael Anderson Thu, 17 May 2012 19:40:18 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52517 Just to make it clear: # head /tmp/db1.sql -- MySQL dump 10.13 Distrib 5.5.22, for Linux (x86_64) -- ... # head /tmp/db2.sql -- MySQL dump 10.13 Distrib 5.5.22, for Linux (x86_64) -- .. Just to make it clear:

# head /tmp/db1.sql
– MySQL dump 10.13 Distrib 5.5.22, for Linux (x86_64)
–
…

# head /tmp/db2.sql
– MySQL dump 10.13 Distrib 5.5.22, for Linux (x86_64)
–
..

]]> By: Michael Andersonhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52516 Michael Anderson Thu, 17 May 2012 19:00:48 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52516 I get lots of crap when I'm comparing two large database dumps that are 30 seconds apart: -- Table structure for tO6`^@^@'¨^@N6½^@^@^H^@O6½^P^@^@^A^@N6¾8^@h^@N6¾8^@X^@O6¿`^@^@^G^H^@N6ÆP^@^H^@O6Æp^@^@^_è^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6çè^@È^@N6è¨^@^H^@N6è¨^@^H^@O6èÀ^@^@^BP^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@O6ë`^@^@^F8^@N6ñP^@^P^@O6ñ¨^@^@^K^@N6ý^@^@ ^@O6ýX^@^@^Bp^@N6þ^@^@^P^@N6ÿØ^@^P^@N6ÿÀ^@^H^@N6þ^@^@^H^@O6ÿø^@^@^C¸^@N7^C^H^@¨^@N7^C^H^@¨^@N7^C^H^@^P^@O7^E^P^@^Aÿà^@N.@^@^H^@O9^Dø^@^@^T`^@N9^Q^@^P^@N9^Yh^@^@N9^R0^@^P^@N9^Z^P^@^H^@N9^RH^@^P^@O9^Z(^@^@*À^@N^AJp^@^H^@O9Dð^@^@^L^X^@N9'^P^@^H^@O9Q^P^@^@Ah^@N9M(^@^H^@O9^@^@bP^@N-ÑØ^@^H^@O9ôØ^@^@^V^@N.U^@^H^@O:^K`^@^@^M^@N:^Wè^@^H^@O:^Xð^@^@ ¸^@N9Ap^@^H^@O:"°^@^@^K^@N9Hø^@^H^@O:.8^@^@^Q¨^@N:>È^@^H^@O:?è^@^@^Nh^@N9_È^@^H^@O:NX^@^@^B^P^@N:-0^@^H^@N:Pp^@h^@N9D^@^H^@O:Pà^@^@^CÐ^@N:)^@^H^@O:T¸^@^@ ^H^@N:r^H^@^H^@N:tÈ^@À^@N:50^@^H^@O:u^@^@^G^P^@N9Ø^@^H^@N:|¨^@`^@N:^Xp^@^H^@O:}^P^@^@^A8^@N9LÐ^@^H^@N:~P^@^X^@N:^UØ^@^H^@O:~p^@^@^A^@^@N.À^@^H^@N:^?x^@P^@N9ø^@^H^@O:^?Ð^@^@^A`^@N9^P^@^H^@N:8^@¨^@N:~x^@^H^@O:è^@^@^Q^P^@N:?0^@^H^@N:^@^@^H^@N^Aê ^@^H^@O:^P^@^@^MP^@N-Ð^@^H^@O: h^@^@^SÐ^@N9¾(^@^H^@O:´@^@^@^F0^@N:h^@^H^@O:ºx^@^@^Z ^@N:p^@^P^@O:Ô¨^@^@^Gè^@N9´Ø^@^P^@O:Ü ^@^@^C^@N:Ð^@^H^@O:à(^@^@^Cp^@N9^¨^@^H^@O:ã ^@^@|`^@N:ø8^@^P^@O;`^P^@^@R ^@N:b ^@^H^@O;²¸^@^\ô^@B^GRT INTO `url_alias` VALUES (221693,'node/207969','connect/companies/lee-associates','und'); I get lots of crap when I'm comparing two large database dumps that are 30 seconds apart:

– Table structure for tO6`^@^@'¨^@N6½^@^@^H^@O6½^P^@^@^A^@N6¾8^@h^@N6¾8^@X^@O6¿`^@^@^G^H^@N6ÆP^@^H^@O6Æp^@^@^_è^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6æ0^@(^@N6çè^@È^@N6è¨^@^H^@N6è¨^@^H^@O6èÀ^@^@^BP^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@N6ë^H^@^H^@O6ë`^@^@^F8^@N6ñP^@^P^@O6ñ¨^@^@^K^@N6ý^@^@ ^@O6ýX^@^@^Bp^@N6þ^@^@^P^@N6ÿØ^@^P^@N6ÿÀ^@^H^@N6þ^@^@^H^@O6ÿø^@^@^C¸^@N7^C^H^@¨^@N7^C^H^@¨^@N7^C^H^@^P^@O7^E^P^@^Aÿà^@N.@^@^H^@O9^Dø^@^@^T`^@N9^Q^@^P^@N9^Yh^@^@N9^R0^@^P^@N9^Z^P^@^H^@N9^RH^@^P^@O9^Z(^@^@*À^@N^AJp^@^H^@O9Dð^@^@^L^X^@N9'^P^@^H^@O9Q^P^@^@Ah^@N9M(^@^H^@O9^@^@bP^@N-ÑØ^@^H^@O9ôØ^@^@^V^@N.U^@^H^@O:^K`^@^@^M^@N:^Wè^@^H^@O:^Xð^@^@ ¸^@N9Ap^@^H^@O:"°^@^@^K^@N9Hø^@^H^@O:.8^@^@^Q¨^@N:>È^@^H^@O:?è^@^@^Nh^@N9_È^@^H^@O:NX^@^@^B^P^@N:-0^@^H^@N:Pp^@h^@N9D^@^H^@O:Pà^@^@^CÐ^@N:)^@^H^@O:T¸^@^@ ^H^@N:r^H^@^H^@N:tÈ^@À^@N:50^@^H^@O:u^@^@^G^P^@N9Ø^@^H^@N:|¨^@`^@N:^Xp^@^H^@O:}^P^@^@^A8^@N9LÐ^@^H^@N:~P^@^X^@N:^UØ^@^H^@O:~p^@^@^A^@^@N.À^@^H^@N:^?x^@P^@N9ø^@^H^@O:^?Ð^@^@^A`^@N9^P^@^H^@N:8^@¨^@N:~x^@^H^@O:è^@^@^Q^P^@N:?0^@^H^@N:^@^@^H^@N^Aê ^@^H^@O:^P^@^@^MP^@N-Ð^@^H^@O: h^@^@^SÐ^@N9¾(^@^H^@O:´@^@^@^F0^@N:h^@^H^@O:ºx^@^@^Z ^@N:p^@^P^@O:Ô¨^@^@^Gè^@N9´Ø^@^P^@O:Ü ^@^@^C^@N:Ð^@^H^@O:à(^@^@^Cp^@N9^¨^@^H^@O:ã ^@^@|`^@N:ø8^@^P^@O;`^P^@^@R ^@N:b ^@^H^@O;²¸^@^\ô^@B^GRT INTO `url_alias` VALUES (221693,'node/207969','connect/companies/lee-associates','und');

]]> By: Harryhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52429 Harry Sat, 10 Mar 2012 01:40:58 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-52429 Your post was very informative, thanks. Your post was very informative, thanks.

]]> By: Fredhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-51153 Fred Mon, 22 Nov 2010 20:21:02 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-51153 I also noticed that this problem is specific to GNU diff. For instance on AIX 5.3 the System V version of diff doesn't have the same issue on the same pair of files. I also noticed that this problem is specific to GNU diff. For instance on AIX 5.3 the System V version of diff doesn't have the same issue on the same pair of files.

]]> By: Oferhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-12903 Ofer Tue, 10 Feb 2009 16:08:47 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-12903 Does anyone know how to view the Delta output "diff"-style? or any other style? Does anyone know how to view the Delta output "diff"-style? or any other style?

]]> By: Artem Russakovskiihttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-7628 Artem Russakovskii Sat, 27 Sep 2008 08:48:30 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-7628 @nailbiter Thanks for the correction - I just assumed that rsync and librsync are related for obvious reasons. @nailbiter
Thanks for the correction – I just assumed that rsync and librsync are related for obvious reasons.

]]> By: nailbiterhttp://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-7581 nailbiter Fri, 26 Sep 2008 06:20:54 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-7581 Just a nitpick: rdiff and rsync don't share any code. rdiff's backend, librsync, just happens to be another implementation of the rsync running-checksum algorithm. The delta files generated by "rsync --write-batch" are also very different to the ones rdiff produces. Just a nitpick: rdiff and rsync don't share any code. rdiff's backend, librsync, just happens to be another implementation of the rsync running-checksum algorithm.

The delta files generated by "rsync –write-batch" are also very different to the ones rdiff produces.

]]> By: Marcel (brimosoft)http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-4448 Marcel (brimosoft) Mon, 19 May 2008 09:20:33 +0000 http://beerpla.net/2008/05/12/a-better-diff-or-what-to-do-when-gnu-diff-runs-out-of-memory-diff-memory-exhausted/#comment-4448 Thank you for commenting on the continuation of the Lazyest Gallery project. Thank you for commenting on the continuation of the Lazyest Gallery project.

]]>