Performance Degradation after Database Enlarge/Expand

Discussion created by ca.portal.admin on Feb 8, 2006
From: Bill Vohs, SC Data Center, Monroe, Wi
Date: February 1, 2006

Subject: Enlarge/Expand IDMS Database Causes Severe Performance

We are running:

z/OS 1.4
IDMS Release 16 SP02

We have a need to enlarge a number of the IDMS databases.

Every time we do, we experience severe performance degradation.
Run times elongate by a factor of 3 to 5.
Job that ran in 30 minutes now takes 3-4 hours.

Our first attempt was back in November 2005.
The approach at that time was to do an UNLOAD and RELOAD to the enlarged
This time we enlarged the databases by a factor of 3.
I.e. One database went from 15,000 tracks to 45,000 tracks.
Another database went from 7,000 tracks to 21,000
These all on 3390 DASD on the EMC DMX2000.

Our run times were:

Before UNLOAD/RELOAD 11/09/2005 74
11/10/2005 46 minutes

After UNLOAD/RELOAD 11/16/2005 174
11/1/2005 198 minutes

This happened with almost every one of our jobs.

Our second attempt was January 29, 2006..
The approach this time was to do a EXPAND PAGE to an enlarged area
This time the databases were enlarged by a factor of 2.
One database went from PAGE SIZE 5064 to 10796 from 15,000 tracks to
Another database went from PAGE SIZE 5064 to 10796 from 7,000 tracks to
14,000 tracks.

The run times are:

Before EXPAND PAGE 01/26/2006

After EXPAND PAGE 01/31/2006
02/01/2006 212 minutes

We have had an IDMS consultant review our work and he says every thing

Our z/OS and IDMS statistics show nothing out of the ordinary.

We are at a bit of a loss.

Might anybody have any suggestion for us?

IDMS Public Discussion Forum


*** Registration for the IUA 2006 Workshop ***
"The IUA is pleased to let you know that registration is now open
for the April 10-12 IUA Workshop in Dallas.

With the potential that the next CA World might be in held in 2007,
this could be the year's largest event for CA-IDMS education
and networking with your peers.

You can access the online registration page by going to our web
site and clicking on EVENTS at the top of the screen.

In the event section you can both register and pay for the workshop
or view detailed information about the event.

The list of course offerings is still being finalized, however, our
preliminary agenda has courses such as;

CA-IDMS Status, plans and futures
Release 16 Overview
DB Navigation
ADSO for Application Development
ADSO Application Performance
R16 SQL Features
User experiences with DARSTRAN
CA-IDMS/DC Internals (6 sessions)
Creating Web Appls with CA-IDMS, COBOL & ADSO
CA-IDMS TCP/IP Interface Setup and Programming
CA-IDMS and the Internet
An entire web and application integration track by Neon Systems

Thanks and I hope to see you in Dallas in April,
Terry Schwartz
IUA Chair

IDMS Public Discussion Forum


Re: Performance Degradation after Database Enlarge/Expand
1. Local mode jobs? Retrieval only?
2. Has online transaction time also taken a hit?

Things to look for:
1. What is the I/O response time? Can you get RMF stats before and after and determine if the I/O respomse has changed?
2. Channel issues? Since you have larger files, you ARE pushing more data. Can the channel handle it?
3. Data placement? Despite best efforts, UNLOAD/RELOAD can't put the data back the way it was put in. I've found that as data is added and subtracted, especially highly volital data, the system seems to hum along, find a ""niche"" for the data. An unload/reload will mess this up by following ""the rules"". It may take a cycle of your business to get the data back to where it really belongs. (Yeah, pretty Zen, huh?)
4. Back to I/O. What files are you accessing? The ""source"" database (the one the CV updates) or a copy? What are you using to copy? I've found degradation in batch jobs due to the hardware ""SNAP"" not really being as fast as it says it is. Maybe all the I/O time is being used by the hardware to REALLY copy files?
Lastly, Everything else that was said is appropriate.

My nickle's worth. (and please excuse any spelling errors!)

Scott Brady
Holland America Line


From: IDMS Public Discussion Forum on behalf of Miley, Dan L
Sent: Wed 2/8/2006 1:58 PM
Subject: Re: Performance Degradation after Database Enlarge/Expand

You didn't mention the type of jobs that were experiencing performance
problems. But if they are doing area sweeps they will of course run
longer. I would suggest that you use prefetch with file buff parm set
to at least 3000. If the jobs are using indexes perhaps a rebuild
would help. That's about all I can say based on the limited information

Dan Miley
Lockheed Martin