Blogs Classifieds Downloads FlashChat Gallery Googlemap Invite Friends Links Projects Reviews Wiki
 


Welcome to the pSeries Tech Forums, our free peer-based support site for administrators, engineers and architects working with IBM pSeries servers and software.

You are currently viewing our site as a guest which gives you limited access to view most discussions, articles, tutorials and access our other free features. By joining our community you will be able to collaborate with administrators, engineers and architects charged with designing, delivering or maintaining IBM pSeries server environments.

Founded by a recognized IBM pSeries consultant and IBM Redbook author, pSeries Tech Forums was developed with the single mission of bringing IBM pSeries professionals together into a single self-help community.

Registration is fast, simple and absolutely free to all IT professionals with responsibility for or interest in IBM pSeries servers. We invite you to join our community today!

If you have any problems with the registration process or your account login, please contact contact support.

Our Sponsors
Want to advertise?  


Reply
 
LinkBack Thread Tools
  #1  
Old June 5th, 2008
DANNYC's Avatar
DANNYC Offline
Junior Member
 
Join Date: July 2006
Posts: 6
I/O problem ???

I need help on a possible performance problem. We have a p560 running AIX v5.3 8 cpu/32gb mem with 2 fiber cards that is running Oracle 10g. Disk I/O is heavy during certain times but from iostat and vmstat output, I don't think there is alot we could do to help performance with
such heavy I/O occurring. Not seeing any paging to page space but seeing heavy paging to file system (via nmon). Attached is a vmstat of what we typical see.

Thanks,

Danny
Attached Files
File Type: txt vmstat_1.txt (1.0 KB, 4 views)

Last edited by DANNYC; June 6th, 2008 at 09:39.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #2  
Old June 6th, 2008
ross.mather's Avatar
ross.mather Offline
Senior Member
 
Join Date: January 2007
Location: Nomadic in the UK
Posts: 407
Re: I/O problem ???

Except for the I/O waits everything looks pretty normal. The I/O waits are not necessarily cause by disk I/O, they could be Network I/O or waiting for another process to complete.

How are your disks set up in this environment? Direct attached Fibre, Local SCSI, Virtual I/O?

How much CPU and how many virtual CPUs do you have?

What are your vmo settings, as that may shed some light on what it is doing?
__________________
Ross Mather, IBM AIX IT Specialist.
That said anything I say here is my own opinion and not anything that you can ever hold against IBM.
Ohhh and don't forget that I make mistakes too....
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #3  
Old June 6th, 2008
DANNYC's Avatar
DANNYC Offline
Junior Member
 
Join Date: July 2006
Posts: 6
Re: I/O problem ???

Thanks for the reply Ross. We are attached to ds6800 disk via our SAN.
The is an 8cpu server with SMT turned on so 16 logical processors.

These vmo setttings are the only ones I changed:
MINPERM%=3
MAXPERM%=90
MAXCLIENT%=90
lru_file_repage=0

AIO is also turned on.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #4  
Old June 6th, 2008
ross.mather's Avatar
ross.mather Offline
Senior Member
 
Join Date: January 2007
Location: Nomadic in the UK
Posts: 407
Re: I/O problem ???

what you'll need to do is to find out which files are being written and see if you can split them off into different SAN LUNs that is probably the only thing you'll be able to do to help.

That sort of analysis is not something I can help you with online. You'll need to use filemon to work out what is going on.
__________________
Ross Mather, IBM AIX IT Specialist.
That said anything I say here is my own opinion and not anything that you can ever hold against IBM.
Ohhh and don't forget that I make mistakes too....
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #5  
Old June 6th, 2008
DANNYC's Avatar
DANNYC Offline
Junior Member
 
Join Date: July 2006
Posts: 6
Re: I/O problem ???

WE truly think the problem is with the way the application manipulating the tables (many full tables scans) in Oracle. Anyway, as always Ross, thanks for your assistance.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #6  
Old June 6th, 2008
kierong's Avatar
kierong Offline
Junior Member
 
Join Date: February 2007
Posts: 19
Re: I/O problem ???

If your Oracle datbase is in filesystem space have you checked the Oracle documentation about using the CIO/DIO filesystem mount option.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #7  
Old June 6th, 2008
DANNYC's Avatar
DANNYC Offline
Junior Member
 
Join Date: July 2006
Posts: 6
Re: I/O problem ???

The dbf's are mounted with Concurrent I/O turned on. Thanks for the reply.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #8  
Old June 7th, 2008
ross.mather's Avatar
ross.mather Offline
Senior Member
 
Join Date: January 2007
Location: Nomadic in the UK
Posts: 407
Re: I/O problem ???

You are correct though that most I/O problems like this with Oracle are caused by the programming at an Oracle level rather than anything else.

But it never hurts to have back up when talking to your DBAs :-).....
__________________
Ross Mather, IBM AIX IT Specialist.
That said anything I say here is my own opinion and not anything that you can ever hold against IBM.
Ohhh and don't forget that I make mistakes too....
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Reply

Bookmarks

Tags
i or o, problem

These are the 100 most searched terms
Search Cloud
0042-001 0042-001 nim 0513-001 the system resource controller daemon is not active 0513-001 the system resource controller daemon is not active. 0514-061 0514-061 cannot find a child device 0514-061 cannot find a child device. 0516-787 0516-787 extendlv 0516-787 extendlv: maximum allocation for logical volume 110000ac aa00e1f3 aio aix aix aio aix freeware aixif_arp_dup_addr b150f22a b181f22a b181fb53 ba010004 c1001020 d133c002 dacnone dcb47997 fcp_array_err6 fget_config gnu tar aix gsclvmd gtar aix hi yall hmc root password hmc vmware hscl05db ibm p6 ibm p6 520 libpopt aix libpopt.a libpopt.a(libpopt.so.0) is needed by rsync-2.6.2-1 migratelv mksysb navisphere agent nim server pseries pseriestech rsync aix sc_disk_err4 scan_error_chrp vio server websm xhost file ... powered by Simple Search Cloud


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.2.0
Powered by vbWiki Pro 1.3 RC5. Copyright ©2006-2007, NuHit, LLC

vBulletin Skin developed by: vBStyles.com


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50