I am throwing up a quick post about a relatively cryptic error that Solr started throwing the other day here at Plaxo. After happily running for a few days, I suddenly started getting pages about failed Solr indexing.

Upon closer examination, I saw the following repeatedly in the log file:

catalina.2009-09-18.log:SEVERE: java.io.IOException: directory 'DATADIR/index'
exists and is a directory, but cannot be listed: list() returned null

I tried to see if sending an OPTIMIZE command would help but the server returned the same response.

Digging Deeper

The reason was these errors was quite simple – Solr was running into the system level limit on allowed number of open files (ulimit). This limit can be seen by running

ulimit -n
1024

or simply

ulimit -a | grep 'open files'
open files                      (-n) 1024

This means that if a process tries to open that many files at the same time, the kernel will prohibit opening any more, which in my case caused the Java IOException.

In my case, I haven't been using the Solr OPTIMIZE command for a while, so after a lot of COMMITs, the Solr data got pretty fragmented, thus hitting the open files limit.

The Solution

There are 2 things to be done here:

1. OPTIMIZE Solr more often. When an OPTIMIZE occurs, multiple index files are merged into 1, thus reducing the number of files that need to be opened. However, before you can OPTIMIZE, you have to raise the allowed number of open files (see the next bullet).

2. Set a higher open files limit for the user that runs Solr (in my case, the solr user) – for example to 4096 instead of 1024. One way to do it is by adding a file /etc/security/limits.d/solr.conf with the following contents:

   solr hard nofile 4096
   solr soft nofile 4096

   and then logging out and back in. The file should be automatically loaded, which you can verify by running the ulimit commands from the section above.

Happy Solring!

By the way, here's a really good resource for Solr 1.4 that just came out: Solr 1.4 Enterprise Search. I have this book and it's quite helpful in explaining such topics as multicore setup, search methods, replication, etc.

• How To Show Hidden/Invisible Files In Total Commander, Both Locally And On An FTP Server
• Comparison Between Solr And Sphinx Search Servers (Solr Vs Sphinx – Fight!)
• Watch – A Useful Linux Command You May Have Never Heard Of
• [Perl] Finding Files, The Fun And Elegant Way
• How To Sort Folders The Same Way As Files In Total Commander

Passwd::Unix will corrupt your /etc/shadow file and rearrange login names and their corresponding password hashes.

The current version of Passwd::Unix corrupted my /etc/shadow upon only
calling the passwd() function. Immediately users started to report not
being able to login.

After examining the situation, I found that Passwd::Unix rearranges all
users in /etc/shadow in some way, but it only does it to the
usernames, and not the password hashes. Thus, you will get corrupted accounts. Moreover,
users are now able to login to one OTHER account, not their own,
depending on how the usernames got shuffled.

Thankfully, I had a recent backup but I definitely don’t want anyone
else to suffer.

I’m using perl 5.10, SUSE 10.3. If it’s incompatible with SUSE, it needs
to say so and exit.

I've filed the bug here: http://rt.cpan.org/Public/Bug/Display.html?id=35323.

You have been warned.

• How *Not* To Implement A Web Application That Handles External Authentication, Using BeTwittered.com As An Example
• cpan – The Perl Module Manager
• A Better diff Or What To Do When GNU diff Runs Out Of Memory ("diff: memory exhausted")
• How To Install The Latest SOAP::Lite Using Perl CPAN
• MySQL Conference Liveblogging: MySQL Performance Under A Microscope: The Tobias And Jay Show (Wednesday 2:00PM)

This article contains my notes and detailed instructions on setting up a MySQL cluster. After reading it, you should have a good understanding of what a MySQL cluster is capable of, how and why it works, and how to set one of these bad boys up. Note that I'm primarily a developer, with an interest in systems administration but I think that every developer should be able to understand and set up a MySQL cluster, at least to make the dev environment more robust.

Notes

• In short, a MySQL cluster allows a user to set up a MySQL database shared between a number of machines. Here are some benefits:
  • High availability. If one or some of the machines go down, the cluster will stay up, as long as there is at least one copy of all data still present. The more redundant copies of data there are, the more machines you can afford to lose.
  • Scalability. Distributed architecture allows for load balancing. If your MySQL database is getting hit with lots of queries, consider setting up a cluster to spread this load in almost linear fashion. A 4 node cluster should be able to handle twice as many queries as a 2 node cluster.
  • Online backups.
  • Full support for transactions.
• Must-have manual: MySQL Clustering by Alex Davies and Harrison Fisk, MySQL Press.
• First and foremost, I would like to get this out of the way (from MySQL Clustering):
  • Response time with MySQL Cluster is quite commonly worse than it is with the traditional setup. Yes, response time is quite commonly worse with clustering than with a normal system. If you consider the architecture of MySQL Cluster, this will begin to make more sense.
  • When you do a query with a cluster, it has to first go to the MySQL server, and then it goes to storage nodes and sends the data back the same way. When you do a query on a normal system, all access is done within the MySQL server itself. It is clearly faster to access local resources than to read the same thing across a network. Response time is very much dependant on network latency because of the extra network traffic. Some queries may be faster than others due to the parallel scanning that is possible, but you cannot expect all queries to have a better response time.
  • So if the response time is worse, why would you use a cluster? First, response time isn't normally very important. For the vast majority of applications, 10ms versus 15ms isn't considered a big difference.
  • Where MySQL Cluster shines is in relation to the other two metrics: throughput and scalability.
• A typical MySQL cluster setup involves 3 components in at least this configuration:
  • 1 management (ndb_mgmd) node.
    • Management nodes contain the cluster configuration.
    • A management node is only needed to connect new storage and query nodes to the cluster and do some arbitration.
    • Existing storage and query nodes continue to operate normally if the management node goes down.
    • Therefore, it's relatively safe to have only 1 management node running on a very low spec machine (configuring 2 management nodes is possible but is slightly more complex and less dynamic).
    • Interfacing with a management node is done via an ndb_mgm utility.
    • Management nodes are configured using config.ini.
    • My setup here involves 1 management node.
  • 2 storage (ndbd) nodes.
    • You do not interface directly with those nodes, instead you go through SQL nodes, described next.
    • It is possible to have more storage nodes than SQL nodes.
    • It is possible to host storage nodes on the same machines as SQL nodes.
    • It is possible, although not recommended, to host storage nodes on the same machines as management nodes.
    • Storage nodes will split up the data between themselves automatically. For example, if you want to store each row on 2 machines for redundancy (NoOfReplicas=2) and you have 6 storage nodes, your data is going to be split up into 3 distinct non-intersecting chunks, called node groups.
    • Given a correctly formulated query, it is possible to make MySQL scan all 3 chunks in parallel, thus returning the result set quicker.
    • Node groups are formed implicitly, meaning you cannot assign a storage node to a specific node group. What you can do, however, is manipulate the IDs of the nodes in such a way that the servers you want will get assigned to the node groups you want. The nodes having consecutive IDs get assigned to the same node group until there are NoOfReplicas nodes in a node group, at which point a node group starts.
    • Storage nodes are configured using /etc/my.cnf. They are also affected by settings in config.ini on the management node.
    • My setup here involves 4 storage nodes.
  • 2 query (SQL) nodes.
    • SQL nodes are regular mysqld processes that access data in the cluster. You guessed it right – the data sits in storage nodes, and SQL nodes just serve as gateways to them.
    • Your application will connect to these SQL node IPs and will have no knowledge of storage nodes.
    • It is possible to have more SQL nodes than storage nodes.
    • It is possible to host SQL nodes on the same machines as storage nodes.
    • It is possible, although not recommended, to host SQL nodes on the same machines as management nodes.
    • SQL nodes are configured using /etc/my.cnf. They are also affected by settings in config.ini on the management node.
    • My setup here involves 4 SQL nodes.
• Normally a cluster doesn't want to start if not all the storage nodes are connected (from MySQL Clustering).
  • Therefore, the cluster waits longer during the restart if the nodes aren't all connected so that the other storage nodes can connect. This period of time is specified in the setting StartPartialTimeout, which defaults to 30 seconds. If at the end of 30 seconds, a cluster is possible (that is, it has one node from each node group) and it can't be in a network partitioned situation (that is, it has all of one node group), the cluster will perform a partial cluster restart, in which it starts up even though storage nodes are missing.
  • If the cluster is in a potential network partitioned setup, where it doesn't have all of a single node group, then it will wait even longer, with a setting called StartPartitionedTimeout, which defaults to 60 seconds.
• Adding databases propagates to all SQL nodes (at least with the latest version of MySQL), so when you create a new database, you only need to do it once on any SQL node. However, users dont propagate, so each SQL node will need to have its own users set up. Warning: do NOT try to change the MySQL internal tables (the ones in database mysql) to type ndbcluster as the cluster will break.
• I will think of something else to put here.

My Setup

This is my sample configuration with sample IPs:

• mysql-5.1.22-rc-linux-i686-icc-glibc23
• 1x management node (OpenSUSE): 10.0.0.1
• 4x storage (ndbd) nodes (OpenSUSE): 10.0.0.2, 10.0.0.3, 10.0.0.4, 10.0.0.5.
• 4x query (SQL) nodes (OpenSUSE): 10.0.0.2, 10.0.0.3, 10.0.0.4, 10.0.0.5.
• NoOfReplicas = 2, meaning there will be 2 copies of all data and therefore 4/2=2 node groups.
• Cluster data will sit in /var/lib/mysql-cluster.

Sample Screenshot

Here is a sample screenshot of another one of my configurations showing a similar setup. This is the output of show on the management node:

Setup Instructions

On the management node (as root):

1
2
3
4
5
6
7

groupadd mysql
useradd -g mysql mysql
mkdir -p /root/src/
cd /root/src/
wget http://dev.mysql.com/get/Downloads/MySQL-5.1/mysql-5.1.22-rc-linux-i686-icc-glibc23.tar.gz/from/http://mysql.he.net/
tar xvzf mysql-*.tar.gz
rm mysql-*.tar.gz

• ndb_mgmd is the management server
• ndb_mgm is the management client

1
2
3
4
5

cp mysql-*/bin/ndb_mg* /usr/bin/
chmod +x /usr/bin/ndb_mg*
mkdir /var/lib/mysql-cluster
chown mysql:mysql /var/lib/mysql-cluster
vi /var/lib/mysql-cluster/config.ini

Download /var/lib/mysql-cluster/config.ini

1
2
3

ndb_mgmd -f /var/lib/mysql-cluster/config.ini
ndb_mgm
show

On each storage and SQL node (as root):

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

groupadd mysql
useradd -g mysql mysql
cd /usr/local
wget http://dev.mysql.com/get/Downloads/MySQL-5.1/mysql-5.1.22-rc-linux-i686-icc-glibc23.tar.gz/from/http://mysql.he.net/
tar xvzf mysql-*.tar.gz
rm mysql-*.tar.gz
ln -s `echo mysql-*` mysql
cd mysql
chown -R root .
chown -R mysql data
chgrp -R mysql .
scripts/mysql_install_db --user=mysql
cp support-files/mysql.server /etc/init.d/
chmod +x /etc/init.d/mysql.server
vi /etc/my.cnf

Download /etc/my.cnf

1
2
3
4
5
6
7
8
9

mkdir /var/lib/mysql-cluster
chown mysql:mysql /var/lib/mysql-cluster
cd /var/lib/mysql-cluster
su mysql
/usr/local/mysql/bin/ndbd --initial # start the storage node and force it to (re)read the config
exit
echo "/usr/local/mysql/bin/ndbd" > /etc/init.d/ndbd
chmod +x /etc/init.d/ndbd
/etc/init.d/mysql.server restart # start the query node

SUSE:

1
2
3
4

chkconfig --add mysql.server # this is SUSE's way of starting applications on system boot
chkconfig --add ndbd
chkconfig --list mysql.server
chkconfig --list ndbd

Ubuntu:

1
2
3
4
5

sudo apt-get install sysv-rc-conf # this is chkconfig's equivalent in Ubuntu
sysv-rc-conf mysql.server on
sysv-rc-conf ndbd on
sysv-rc-conf --list mysql.server
sysv-rc-conf --list ndbd

That's it! At this point you should go back to the management console that you logged into earlier (ndb_mgm) and issue the 'show' command again. If everything is fine, you should see your data and SQL nodes connected. Now you can login to any SQL node, make some users, and create new ndb tables. If you're experiencing problems, do leave a message in the comments.

In the next mysql cluster article, I will explore various cluster error messages I have encountered as well as config file tweaking. Now go and spend some time outside in the sun – life is too short to waste it at a dark office.

• MySQL Conference Liveblogging: Portable Scale-out Benchmarks For MySQL (Wednesday 10:50AM)
• MySQL Conference Liveblogging: Performance Guide For MySQL Cluster (Tuesday 10:50AM)
• MySQL Conference Liveblogging: The Future Of MySQL (Tuesday 11:55AM)
• MySQL Falcon Storage Engine Enters Beta Stage.
• MySQL Slave Lag (Delay) Explained And 7 Ways To Battle It

Well, "good news everyone". Thanks to Sheeri Cabral of The Pythian Group, PlanetMySQL.org, Jeremy, and, most importantly, LinuxQuestions.org, I am now in possession of a 3-day conference pass!! I'm incredibly excited that I will be able to attend and finally meet many geniuses, including the ones mentioned on my Must-Know People In The MySQL Field page. I've never won anything worth over 50 cents before. As a funny side note, there were 4 pages of replies to the raffle post, 90% of them saying that they could not attend (mostly due to living in other countries), so in reality only 2-3 people out of everyone could actually attend. I like those odds.

Here is a link to the oh so colorful conference schedule. I'm particularly interested in this short list of highly exciting subjects:

April 15th

• State of MySQL – the keynote by Mårten Mickos (former CEO of MySQL).
• Performance Guide for MySQL Cluster – parallel query processing guide perhaps?
• Lessons Learned in Building a Highly Scalable MySQL Database – definitely need more lessons.
• Big Bird (Scaling Twitter) – should be fun, considering I heard twitter was started in ruby on rails and had major problems scaling out.
• InnoDB: Status, Architecture, and New Features – an update would be nice, kthx.
• Dramatically Improving MySQL Database Performance in Data Warehouse Applications – more lessons!
• Investigating Innodb Scalability Limits by Peter Zaitsev from MySQL Performance Blog!
• Disaster is Inevitable—Are You Prepared? by Farhan Mashraqi from Fotolog.
• Mitigating Replication Latency in a Distributed Application Environment – I need to get rid of these constant replication lags already, for the love of god!

April 16th

• Portable Scale-out Benchmarks for MySQL – tasty MySQL bench goodies? Sign me up.
• Applied Partitioning and Scaling Your Database System – sharding, disk spanning? Whatever this will be, I'm all ears.
• Architecture of Maria: A New Storage Engine with a Transactional Design – I'm very interested in this new, very promising future replacement engine for MyISAM.
• Astronomy, Petabytes, and MySQL – sounds like fun. I liked astronomy… I think.
• Benchmarking and Monitoring: Tools of the Trade (Part I) – more tools, invaluable.
• Benchmarking and Monitoring: Tools of the Trade (Part II) – even more? Tool overload for today.

April 17th

• A Match Made in Heaven? The Social Graph and the Database – by Jeff Rothschild from Facebook.com, sounds like something to wake me up in the morning.
• Stored Routines: Tips, Tricks, and Solutions
• MySQL Proxy, the Friendly Man in the Middle – probably one of the most interesting things in development right now.
• Sphinx: High Performance Full Text Search for MySQL
• Helping InnoDB Scale on Servers with Many CPU Cores and Disks – more scaling, always good.
• MySQL Hidden Treasures – man, how do I combine 3 sessions that go on at the same time?
• Top 20 DB Design Tips Every Architect Needs to Know
• Partitioned mySQL and …. realtime – by Dathan Pattishall from Flickr.
• Deadly Sins Using MySQL and PHP – by Arjen Lentz

April 18th

• temporarily unload all the information gathered in the previous 3 days and drown in beer

Excitement is in the air. Can you FEEL IT?

• My MySQL Conference Schedule
• MySQL Conference Liveblogging: Portable Scale-out Benchmarks For MySQL (Wednesday 10:50AM)
• MySQL Conference Liveblogging: Monitoring Tools (Wednesday 5:15PM)
• Must-Know People In The MySQL Field
• MySQL Conference Liveblogging: The Future Of MySQL (Tuesday 11:55AM)

The combination is

1

; A A D

If after pressing ; you see

1

[Command ";" not defined for this screen. Use ? for help]

then you don't have a check in the "Enable aggregate command set" settings checkbox. To enable it, go to the main menu (M) -> Setup (S) -> Config (C) and scroll down to "Enable aggregate command set". Then press X (to check it), E (Exit). Now repeat the above.

• How To Fix Palm Pre's "Error Sending Mail" Problem
• Some Useful vim Commands – My vim Cheatsheet
• Setting Up A MySQL Cluster
• MySQL Conference Liveblogging: Optimizing MySQL For High Volume Data Logging Applications (Thursday 2:50PM)
• Thoughts on Google Chrome

If you are seeing similar problems, here's the fix. After digging around a bit, I have discovered that the problem was incorrect data encoding. My character set was set to KOI8-R while ncurses expected UTF-8. Here is how to change the corresponding setting in putty:

… and SecureCRT:

Now restart YaST and voila:

P.S. You may be wondering why my screen (the GNU one) has a handy footer bar and how to configure it. Not to worry, I will be posting more info on it soon.

• How To Check If The Local SVN Revision Is Up-To-Date
• Crazy Optical Illusion That Makes You Hallucinate – For Real
• Supercharge Your GNU Screen With A Power "Taskbar" And Never Feel Lost Again
• Mastering The Linux Shell – Bash Shortcuts Explained (Now With Cheat Sheets)
• How To Fix Palm Pre's "Error Sending Mail" Problem

cpan

Install a module:

cpan install MODULE

Upgrade a module:

cpan upgrade MODULE

Reinstall a module or force install in case of failed tests:

force install MODULE

See a list of upgradable modules:

r

See cpan configuration (that's the letter 'o'):

o conf

Update an option in cpan configuration:

o conf OPTION_NAME OPTION_VALUE

It is always nice to:

upgrade CPAN
install Bundle::CPAN

If there's an error making a Perl module, it can be caused by a missing make path in cpan configuration. In cpan, type in:

o conf

which will show all cpan options, then:

o conf make /usr/bin/make
o conf commit

A good option is:

o conf prerequisites_policy follow

By default, cpan will prompt to install every dependecy while installing a module. This option will automatically install dependencies without prompting.

• How To Install The Latest SOAP::Lite Using Perl CPAN
• Do NOT Use This Perl Module: Passwd::Unix
• How To Make Your Site Lightning Fast* By Compressing (deflate/gzip) Your HTML, Javascript, CSS, XML, etc In Apache
• [Perl] How To Get The Path Of An Included Library (.pm), Regardless Of Current Directory
• How To Download And Install Windows Media Player 11 Bypassing WGA

Full description is available here: http://sysbench.sourceforge.net/docs/

install mysql, mysql-devel
wget http://downloads.sourceforge.net/project/sysbench/sysbench/0.4.12/sysbench-0.4.12.tar.gz
tar xvzf sysbench*gz
cd sysbench*
./configure && make install

mysql tests

This will run 10 separate consecutive mysql tests using an InnoDB table type, each with 100 mysql threads, doing a total of 1000 various SQL operations per test. Then it will print the total time they took to finish:

sysbench --test=oltp --mysql-user=USER --mysql-password=PASS --mysql-db=test \
  --mysql-host='HOST' --mysql-table-engine=innodb prepare
 
time perl -e "foreach(1..10){print \`sysbench --max-requests=1000 --test=oltp \
  --mysql-user=USER --mysql-password=PASS --mysql-db=test --mysql-host='HOST' \
  --mysql-table-engine=innodb --num-threads=100 run\`}"
 
sysbench --test=oltp --mysql-user=USER --mysql-password=PASS --mysql-db=test \
  --mysql-host='HOST' cleanup

• MySQL Falcon Storage Engine Enters Beta Stage.
• How *Not* To Implement A Web Application That Handles External Authentication, Using BeTwittered.com As An Example
• MySQL Conference Liveblogging: Introduction To The BLOB Streaming Project (Wednesday 3:00PM)
• MySQL Conference Liveblogging: Benchmarking Tools (Wednesday 4:25PM)
• MySQL Conference Liveblogging: Portable Scale-out Benchmarks For MySQL (Wednesday 10:50AM)

NAME
watch – execute a program periodically, showing output fullscreen

SYNOPSIS
watch [-dhvt] [-n ] [--differences[=cumulative]] [--help]
[--interval=] [--no-title] [--version]

DESCRIPTION
watch runs command repeatedly, displaying its output (the first screen
full). This allows you to watch the program output change over time.
By default, the program is run every 2 seconds; use -n or –interval to
specify a different interval.

The -d or –differences flag will highlight the differences between
successive updates. The –cumulative option makes highlighting
"sticky", presenting a running display of all positions that have ever
changed. The -t or –no-title option turns off the header showing the
interval, command, and current time at the top of the display, as well
as the following blank line.

watch will run until interrupted.

NOTE
Note that command is given to "sh -c" which means that you may need to
use extra quoting to get the desired effect.

Note that POSIX option processing is used (i.e., option processing
stops at the first non-option argument). This means that flags after
command don't get interpreted by watch itself.

EXAMPLES
To watch for mail, you might do

watch -n 60 from

To watch the contents of a directory change, you could use

watch -d ls -l

If you're only interested in files owned by user joe, you might use

watch -d 'ls -l | fgrep joe'

To see the effects of quoting, try these out

watch echo $$
watch echo '$$'
watch echo "'"'$$'"'"

You can watch for your administrator to install the latest kernel with

watch uname -r

(Just kidding.)

Now if anyone knows how to make watch print the bottom part of the command output rather than the top, please post a comment.

Edit: BSD users, "watch" out. watch does something completely different on BSD (it lets you snoop on other users' ttys). The corresponding BSD command is actually cmdwatch.

• How To Show Hidden/Invisible Files In Total Commander, Both Locally And On An FTP Server
• How To Display Just The HTTP Response Code In Command Line Curl
• Converting from CVS to SVN: Developer's Notes And Why SVN Is Better
• Modern-Day Frame Busting With X-FRAME-OPTIONS And "This content cannot be displayed in a frame" Warnings
• How To Sort Folders The Same Way As Files In Total Commander

apt-get update
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386 release
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Get:1 ftp://ftp4.gwdg.de SuSE/10.2-i386 release
Ign ftp://ftp4.gwdg.de SuSE/10.2-i386 release
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/base pkglist
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/base release
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/update pkglist
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Get:1 ftp://ftp4.gwdg.de SuSE/10.2-i386/base pkglist
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/update release
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Err ftp://ftp4.gwdg.de SuSE/10.2-i386/base pkglist
Unable to fetch file, server said 'Failed to open file.  '
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/security pkglist
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Get:2 ftp://ftp4.gwdg.de SuSE/10.2-i386/base release
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/security release
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Ign ftp://ftp4.gwdg.de SuSE/10.2-i386/base release
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/rpmkeys pkglist
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Get:3 ftp://ftp4.gwdg.de SuSE/10.2-i386/update pkglist
Err ftp://mirrors.mathematik.uni-bielefeld.de SuSE/10.2-i386/rpmkeys release
Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Err ftp://ftp4.gwdg.de SuSE/10.2-i386/update pkglist
Unable to fetch file, server said 'Failed to open file.  '
Get:4 ftp://ftp4.gwdg.de SuSE/10.2-i386/update release
Ign ftp://ftp4.gwdg.de SuSE/10.2-i386/update release
Get:5 ftp://ftp4.gwdg.de SuSE/10.2-i386/security pkglist
Err ftp://ftp4.gwdg.de SuSE/10.2-i386/security pkglist
Unable to fetch file, server said 'Failed to open file.  '
Get:6 ftp://ftp4.gwdg.de SuSE/10.2-i386/security release
Ign ftp://ftp4.gwdg.de SuSE/10.2-i386/security release
Get:7 ftp://ftp4.gwdg.de SuSE/10.2-i386/rpmkeys pkglist
Err ftp://ftp4.gwdg.de SuSE/10.2-i386/rpmkeys pkglist
Unable to fetch file, server said 'Failed to open file.  '
Get:8 ftp://ftp4.gwdg.de SuSE/10.2-i386/rpmkeys release
Ign ftp://ftp4.gwdg.de SuSE/10.2-i386/rpmkeys release
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/release  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.base  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/release.base  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.update  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/release.update  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.security  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/release.security  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.rpmkeys  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/SuSE/10.2-i386/base/release.rpmkeys  Could not resolve 'mirrors.mathematik.uni-bielefeld.de'
Failed to fetch ftp://ftp4.gwdg.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.base  Unable to fetch file, server said 'Failed to open file.  '
Failed to fetch ftp://ftp4.gwdg.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.update  Unable to fetch file, server said 'Failed to open file.  '
Failed to fetch ftp://ftp4.gwdg.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.security  Unable to fetch file, server said 'Failed to open file.  '
Failed to fetch ftp://ftp4.gwdg.de/pub/linux/suse/apt/SuSE/10.2-i386/base/pkglist.rpmkeys  Unable to fetch file, server said 'Failed to open file.  '

The easiest solution is to download and install the rpms from ftp://ftp5.gwdg.de/pub/opensuse/repositories/home%3A/rbos/openSUSE_10.2/i586/ instead, which come with the correct sources.list as pointed to by this post. Here it is (with the additional sources uncommented):

# A very basic sources.list file.
#
# Fastest repository comes first, with netselect it is possible to determine
# the fastest repository easily.
 
repomd http://ftp-1.gwdg.de/pub/suse/i386 update/10.2
repomd http://ftp-1.gwdg.de/pub/opensuse/distribution 10.2/repo/oss/suse
 
# Visit http://software.opensuse.org/download/ to determine which additional
# components are available.  Some examples are given below, just uncomment
# the line to enable it.
 
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories home:/rbos/openSUSE_10.2
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories KDE:/KDE3/openSUSE_10.2
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories KDE:/Backports/openSUSE_10.2
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories KDE:/Playground/openSUSE_10.2
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories mozilla/openSUSE_10.2
repomd ftp://ftp-1.gwdg.de/pub/opensuse/repositories openSUSE:/Tools/openSUSE_10.2
repomd ftp://ftp.gwdg.de/pub/linux/misc              packman/suse/10.2
 
# The apt format
# rpm ftp://mirrors.mathematik.uni-bielefeld.de/pub/linux/suse/apt/ @ftp_dir@ base update security rpmkeys
# rpm ftp://ftp4.gwdg.de/pub/linux/suse/apt/ @ftp_dir@ base update security rpmkeys

Updating this list produces a much nicer result:

apt update
Get:1 http://ftp-1.gwdg.de update/10.2 repomd.xml [1231B]
Get:2 http://ftp-1.gwdg.de 10.2/repo/oss/suse repomd.xml [951B]
Get:3 ftp://ftp-1.gwdg.de home:/rbos/openSUSE_10.2 repomd.xml [951B]
Get:4 ftp://ftp.gwdg.de packman/suse/10.2 repomd.xml [951B]
Get:5 ftp://ftp-1.gwdg.de KDE:/KDE3/openSUSE_10.2 repomd.xml [951B]
Get:6 ftp://ftp-1.gwdg.de KDE:/Backports/openSUSE_10.2 repomd.xml [951B]
Get:7 ftp://ftp-1.gwdg.de KDE:/Playground/openSUSE_10.2 repomd.xml [951B]
Get:8 ftp://ftp-1.gwdg.de mozilla/openSUSE_10.2 repomd.xml [951B]
Get:9 ftp://ftp-1.gwdg.de openSUSE:/Tools/openSUSE_10.2 repomd.xml [951B]
Fetched 8839B in 8s (1059B/s)
Get:1 http://ftp-1.gwdg.de update/10.2/ primary.xml [724kB]
Get:2 ftp://ftp-1.gwdg.de home:/rbos/openSUSE_10.2/ primary.xml [28.8kB]
Get:3 ftp://ftp.gwdg.de packman/suse/10.2/ primary.xml [2286kB]
Get:4 ftp://ftp-1.gwdg.de home:/rbos/openSUSE_10.2/ filelists.xml [46.5kB]
Get:5 http://ftp-1.gwdg.de update/10.2/ filelists.xml [4061kB]
Get:6 ftp://ftp-1.gwdg.de KDE:/KDE3/openSUSE_10.2/ primary.xml [112kB]
Get:7 ftp://ftp-1.gwdg.de KDE:/KDE3/openSUSE_10.2/ filelists.xml [1212kB]
Get:8 ftp://ftp.gwdg.de packman/suse/10.2/ filelists.xml [3021kB]
Get:9 ftp://ftp-1.gwdg.de KDE:/Backports/openSUSE_10.2/ primary.xml [174kB]
Get:10 ftp://ftp-1.gwdg.de KDE:/Backports/openSUSE_10.2/ filelists.xml [445kB]
Get:11 http://ftp-1.gwdg.de 10.2/repo/oss/suse/ primary.xml [6272kB]
Get:12 ftp://ftp-1.gwdg.de KDE:/Playground/openSUSE_10.2/ primary.xml [16.7kB]
Get:13 ftp://ftp-1.gwdg.de KDE:/Playground/openSUSE_10.2/ filelists.xml [39.0kB]
Get:14 ftp://ftp-1.gwdg.de mozilla/openSUSE_10.2/ primary.xml [22.8kB]
Get:15 ftp://ftp-1.gwdg.de mozilla/openSUSE_10.2/ filelists.xml [339kB]
Get:16 ftp://ftp-1.gwdg.de openSUSE:/Tools/openSUSE_10.2/ primary.xml [6095B]
Get:17 ftp://ftp-1.gwdg.de openSUSE:/Tools/openSUSE_10.2/ filelists.xml [14.5kB]
Get:18 http://ftp-1.gwdg.de 10.2/repo/oss/suse/ filelists.xml [12.4MB]
Fetched 31.2MB in 1m18s (400kB/s)
Reading Package Lists... Done
Building Dependency Tree... Done

Now we got a working apt for SUSE 10.2.

• How To Fix Redrawing Problems In Your VNC
• Linux openSUSE 10.2 Learning Experience #1: Introduction
• Do NOT Use This Perl Module: Passwd::Unix
• Setting Up A MySQL Cluster
• How To Fix ERROR_NOT_FOUND 0×80070490 During Windows 7 SP1 Installation

• introduce the new Linux section of the site (specifically dedicated to openSUSE).
• provide a very short description of Linux and compare it to other operating systems.
• answer some installation questions.

I'm a Windows user, I admit it. Not because I enjoy frequent reboots, freezes, and other unexplainable quirks. It's mostly because I have so many programs I'm used to, it would be impossible to switch to anything else, and I know ins and outs that allow me to be very comfortable with the Windows. I'm talking 20-30 programs I'm not willing to give up any time soon.

However, I also have deep respect for *nix based systems. I started using them back in college and continued later on when I worked at Intel (Solaris) and other jobs. Stability and abundance of open-source software that just works attracted me to Linux. Finally, being a user just wasn't going to cut it: I had way too many questions about how things work, how the OS boots, what the conventions are, etc, etc, etc. So, finally, a couple of days ago I picked openSUSE 10.2 as my distro (distribution) of choice to play around with. The Linux section here on the site has been empty for a while, so I'm going to fill it up by documenting all my experiences and questions throughout the whole learning process as seen with the eyes of an amateur, which, I think, is what most tutorials are missing. So, let's begin.

OK, so… what are all these distributions? Ubuntu, who hasn't heard that by now? SUSE? Fedora? Why can't Linux be just Linux, just like Windows is just Windows? In short, in my opinion, because nobody but Microsoft has access to the Windows code (technically, after that leak a couple of years ago, everyone had a chance to see kernel source, but nobody can actually modify the OS or release another one based on it). Linux is open source, anybody can contribute to its development. That's the beauty of Linux: collaboration of hundreds thousands of people often working on their own time with passion no employee on payroll can match. Some motivated individuals go even further: they compile a set of Linux components that they think would work best together and release it as a distribution. openSUSE is a fine example of that. A bunch of smart people over at Novell got together and produced openSUSE a while ago, with its main goals being:

• Make openSUSE the easiest Linux distribution for anyone to obtain and the most widely used open source platform.
• Provide an environment for open source collaboration that makes openSUSE the world's best Linux distribution for new and experienced Linux users.
• Dramatically simplify and open the development and packaging processes to make openSUSE the platform of choice for Linux hackers and application developers.

See this openSUSE.org about page for more info.

Installing Linux is easier than ever. Back in the day, Linux puzzled average users. Nowadays, for everyday activities Linux is as easy to use as Windows (or Mac if you're into big shiny objects). A short installation guide by Novel is available here and a very nice long guide by HowToForge is available here. If you breeze through the installation steps, you should have a shiny desktop ready to rock and roll in about 30 minutes. While the installation itself is very easy (just burn a CD/DVD from http://download.opensuse.org and reboot the computer), I had a couple of questions about things I wasn't quite sure about. Here they are:

• You're prompted to select your Desktop. The choices are KDE, GNOME, and Other (the Other menu has serveral options, one being no graphical desktop, which you would use if you didn't want a GUI at all, for example for server installs or if you imagined myself as an uber leet hax0r). A graphical desktop is a bit like a skin for the OS. Each also includes different sets of tools, for example KDE's default editor is KEdit while GNOME's is gedit. There are other differences, but for now we have to pick one. The good news is that you can install both later via the software update tool called YaST (actually it's yast2 in SUSE 10.2, yast is just a symlink to /sbin/yast2) and switch between them with ease. For my particular installation, I picked KDE as the desktop manager, which I ended up enjoying quite a lot.

• Correct partitioning of my 110GB hard drive raised the most questions out of all the installation prompts. After consulting with a friendly sysadmin from work, I ended up with
  • 1.0GB swap partition with swap filesystem. I have 2GB RAM, so 1GB swap in case I run out of RAM should suffice.
  • 100MB /boot partition with ext3 filesystem. /boot is where a boot loader like GRUB will reside. We don't want to piss off GRUB, so we'll give it a separate partition.
  • ###MB /tmp partition with ext3 filesystem. /tmp stores temp files for all users. It is better to assign a separate partition to it so that malicious users cannot potentially flood it with useless data and cause the server to run out of space. Don't make this space too small though, so that legitimate users don't run out of temp space.
  • ###MB /var partition with ext3 filesystem. /var can also run the server out of space quickly if a runaway log file fills it up (normally, in /var/log). Assign a few gigs to this dir depending on total space.
  • The rest of the drive I assigned to / with ext3 filesystem. Some people also recommend assigning a separate partition to /home, which is probably a good idea if you're planning on having multiple users on the box. I picked ext3 after reading up online about various filesystem types. ReiserFS was not really an option anymore, since it wasn't too stable yet, and the creator of Reiser was recently arrested for murdering his wife. 2 days after the news broke out, SUSE creators officially announced ext3 as the recommended SUSE filesystem. When ext4 comes out, ext3 partitions will be easily upgradeable to ext4 without the need for repartitioning. The only drawback that I could find for ext3 is the ~32k directory and file limit in a single directory. Oh well, as long as I know about it, I'll be able to craft my applications with that in mind.
  • Update 3/20/2008: I found a great Filesystem Hierarchy Standard document that explains all the dirs in detail here.

• Since I was planning on letting my router (Linksys WRT54G with HyperWRT firmware) handle the firewall duties, I disabled the firewall in the Network part of the installation. It's probably a good idea to leave it on and open ports like SSH (22), FTP (20-21), or HTTP (80) manually. I'm probably going to turn the firewall back on after a couple of weeks once I get the hang of everything.

Well, that should do it for this introduction. In the following articles, I will share my experiences dealing with something something specific, writing as I learn myself. They may be dedicated to software installation and usage, for example, proftpd ftp server. In other articles I may visit Linux concepts, like how to make programs start up at boot time.

• How To Resize/Grow VMware Linux Disks and Partitions
• Ubuntu Laptop Installation
• The Repositories For apt-get In SUSE 10.2
• Beer Planet is Fast Again
• The Most Awesome VPN Tip: How To Make Windows Automatically Use Your Local WiFi/LAN Connection Directly For Requests That Don't Need To Go Through VPN

Installed Ubuntu LTS 6.06 as a 2nd OS on my Dell E1505 laptop today after delaying doing this for a while. This article from digg finally made me install it, which took roughly 10 minutes, as it mentions. Compare this and 0 reboots to 45min and 5 reboots installing Windows. Ubuntu's pretty damn sweet; I'm gonna go tweak it now with the help of Arthur. I'm predicting that Linux (and Ubuntu in particular, as of now) will eat up Windows' market share surely and quickly. The dual boot is very friendly, it uses GRUB as the boot manager. To boot directly into Windows by default, I edited /boot/grub/menu.list from Ubuntu.

• Linux openSUSE 10.2 Learning Experience #1: Introduction
• How To Download And Install Windows Media Player 11 Bypassing WGA
• How To Resize/Grow VMware Linux Disks and Partitions
• Sprint And HTC Release The First HTC Hero Firmware Update 1.56: Fixes Major Bugs, Adds Small Tweaks
• How To Export/Import Your ExpanDrive/SFTPDrive Drives And Settings