kaio timeout on Solaris 10

From: Deborah Crocker (crock@bama.ua.edu)
Date: Tue May 23 2006 - 12:09:58 EDT


I've got a problem involving Solaris 10, Veritas, Oracle, and our Sun
6320 SAN. I'm starting with this list because I believe the problem
is down at the UFS filesystem level, with perhaps, veritas implicated.

We are trying to migrate UFS filesystems on the SAN that hold oracle
from a solaris 9 system to a solaris 10 system. Both systems are
running veritas 4.1 volume manager. We migrate by deporting the
diskgroups, pointing the LUNS to the new box and importing them in.
Everything gets migrated this way, including the oracle code tree.
Nothing is cloned or copied.

The problem we had was that oracle moved in this way would not run on
the new system. The databases would hang indefinitely with an "aiowait
timeout" on the log files.

We could use the filesystems for more routine operations (ls, touch,
cat etc).

On the new system (solaris 10) we can normally run oracle. We created a
new database and it ran. We also cloned over the oracle code and an
oracle instance from the old box and it ran fine.

Logging was turned on for these filesystems. Interestingly, when I
dismounted the filesystems and did an fsck, some would come back with
an error on the cylindar group check. All the filesystems were fsck'd
and remounted and still oracle would hang. Also, aiowait hung with and
without forcedirectio.

I see problems noted for kaio on earlier versions of solaris (<=8 so
too old) and I see references to turning off aysnch io in oracle (not
an option). I also see references to veritas qio for vxfs (not in
use). I do have to put in the veritas MP1 patch on solaris 10.

We tried to migrate last Sunday and I think we need to schedule another try
this coming Sunday but I need a definite fix before we go ahead.

So, has anyone seen this problem in a similar setup?

Thanks

D. Crocker

***********************************************************************
     Deborah Crocker, Ph.D. deborah.crocker@ua.edu
     Unix System Project Leader http://bama.ua.edu/~crock
     Office of Information Technology 205-348-3758
     University of Alabama Fax: 205-348-3993
     Box 870346
     Tuscaloosa, AL 35487
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:39:55 EDT