ca.portal.admin

Re:Re: [IDMSVENDOR-L] automating journal file concatenation

Discussion created by ca.portal.admin on Feb 12, 2010
Hi

I really like the SHARE.ORG program SPECGDGC, which processes GDGs in
desired order.

Just feed it the gdg base name and it copies all generations

//step exec program=specgdgc,parm='all.my.daily.journals'

It is on share tape 18, well I think that is what it is called, tape
18.....

I have seen this used for many years at some large sites hence avoiding
writing journal concatenation rexx execs.
.
I have also heard, through the grapevine, a software supplier has program
of this type in planning.




Rob Klan/Cincinnati/IBM
Phone: 1-877-205-4871 (T/L: 349-2446)
VOIP Users 1-513-897-8148
ITN: 23492446
Email: rklan@us.ibm.com



From:
Chris Hoelscher <choelscher@HUMANA.COM>
To:
IDMS-L@LISTSERV.IUASSN.COM
Date:
02/12/2010 01:40 PM
Subject:
Re: [IDMSVENDOR-L] automating journal file concatenation
Sent by:
IDMS Public Discussion Forum <IDMS-L@LISTSERV.IUASSN.COM>



key - we run an IDCAMS to determine the datasets created during the
business cycle (day or week depending upon how frequently we backup) -
sort by generation # (ascending) - throw the formatted DD cards into an
INCLUDE librate, and run an ICEGENER to concatenate into a daily backup

we then take the same output from IDCAMS, format into DELETE statements,
and run IDCAMS again to delete the just-rolled-up journal tapes

Chris Hoelscher
IDMS/DB2 Database Architect
Humana Inc
502-476-2538
choelscher@humana.com

you only need to test the programs that you want to work correctly






From:
""Rozeboom, Kay [DAS]"" <KAY.ROZEBOOM@IOWA.GOV>
To:
IDMSVENDOR-L@LISTSERV.IUASSN.COM
Date:
02/12/2010 12:42 PM
Subject:
[IDMSVENDOR-L] automating journal file concatenation
Sent by:
IDMS 3rd-party providers forum <IDMSVENDOR-L@LISTSERV.IUASSN.COM>



Before trying to reinvent the wheel, I thought I would ask how others have
=
accomplished this: I am looking for a way to automate the generation of
DD=
statements for a job to concatenate journal offload files for the
previous=
day. Our journal offload file DSN's contain the date and time of offload
=
as part of their names. So it is easy enough to create the DD statements
m=
anually. (Just cut and paste the DSN's from TSO panel 3.4.) But we would
=
like automate the process.

Kay Rozeboom
State of Iowa
Information Technology Enterprise
Department of Administrative Services
Telephone: 515.281.6139 Fax: 515.281.6137
Email: Kay.Rozeboom@Iowa.Gov



The information transmitted is intended only for the person or entity to
which it is addressed and may contain CONFIDENTIAL material. If you
receive this material/information in error, please contact the sender and
delete or destroy the material/information.
"
IDMS Public Discussion Forum
IDMS-L@LISTSERV.IUASSN.COM
SMTP
IDMS-L@LISTSERV.IUASSN.COM
IDMS-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"We use a much simpler method. When offloading journals, we add the
offloaded journal file to an aggregate journal file. Once a day in the
evening backup job, we dump the aggregate file to tape and then recreate
the aggregate file so we essentially have a day's worth of journals on
one tape. It is not exactly a real-time day because of when the job is
run, but since it is run at about the same time every day, it is what I
could call a 'processing' day.

Hope this helps,
Petra
>
>
>
From:
""Rozeboom, Kay [DAS]"" <KAY.ROZEBOOM@IOWA.GOV>
To:
IDMSVENDOR-L@LISTSERV.IUASSN.COM
Date:
02/12/2010 12:42 PM
Subject:
[IDMSVENDOR-L] automating journal file concatenation
Sent by:
IDMS 3rd-party providers forum <IDMSVENDOR-L@LISTSERV.IUASSN.COM>



Before trying to reinvent the wheel, I thought I would ask how others have
=
accomplished this: I am looking for a way to automate the generation of
DD=
statements for a job to concatenate journal offload files for the
previous=
day. Our journal offload file DSN's contain the date and time of offload
=
as part of their names. So it is easy enough to create the DD statements
m=
anually. (Just cut and paste the DSN's from TSO panel 3.4.) But we would
=
like automate the process.

Kay Rozeboom
State of Iowa
Information Technology Enterprise
Department of Administrative Services
Telephone: 515.281.6139 Fax: 515.281.6137
Email: Kay.Rozeboom@Iowa.Gov



The information transmitted is intended only for the person or entity to
which it is addressed and may contain CONFIDENTIAL material. If you
receive this material/information in error, please contact the sender and
delete or destroy the material/information.


"
IDMS 3rd-party providers forum
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP
IDMSVENDOR-L@LISTSERV.IUASSN.COM
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"We use a much simpler method. When offloading journals, we add the
offloaded journal file to an aggregate journal file. Once a day in the
evening backup job, we dump the aggregate file to tape and then recreate
the aggregate file so we essentially have a day's worth of journals on
one tape. It is not exactly a real-time day because of when the job is
run, but since it is run at about the same time every day, it is what I
could call a 'processing' day.

Hope this helps,
Petra
>
>
>
From:
""Rozeboom, Kay [DAS]"" <KAY.ROZEBOOM@IOWA.GOV>
To:
IDMSVENDOR-L@LISTSERV.IUASSN.COM
Date:
02/12/2010 12:42 PM
Subject:
[IDMSVENDOR-L] automating journal file concatenation
Sent by:
IDMS 3rd-party providers forum <IDMSVENDOR-L@LISTSERV.IUASSN.COM>



Before trying to reinvent the wheel, I thought I would ask how others have
=
accomplished this: I am looking for a way to automate the generation of
DD=
statements for a job to concatenate journal offload files for the
previous=
day. Our journal offload file DSN's contain the date and time of offload
=
as part of their names. So it is easy enough to create the DD statements
m=
anually. (Just cut and paste the DSN's from TSO panel 3.4.) But we would
=
like automate the process.

Kay Rozeboom
State of Iowa
Information Technology Enterprise
Department of Administrative Services
Telephone: 515.281.6139 Fax: 515.281.6137
Email: Kay.Rozeboom@Iowa.Gov



The information transmitted is intended only for the person or entity to
which it is addressed and may contain CONFIDENTIAL material. If you
receive this material/information in error, please contact the sender and
delete or destroy the material/information.


"
IDMS Public Discussion Forum
IDMS-L@LISTSERV.IUASSN.COM
SMTP
IDMS-L@LISTSERV.IUASSN.COM
IDMS-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"we tried this for 5 years - but we had to abandon - throughout the day
on especially on heavy CVs - the offload + append job would take longer
and longer to run as the aggrgate would get bigger and bigger (this was
tape which was probably a mistake) - at times all journals would fill
becuase it took to long to run one offload job and they were of course
singltthreaded

we now offload journals and logs as they fill - and then run an idcams
to get the GDGs created during the day and build a daily tape and then
delete the GDGs just merged

chris

Petra LaFrese wrote:
We use a much simpler method. When offloading journals, we add the
offloaded journal file to an aggregate journal file. Once a day in the
evening backup job, we dump the aggregate file to tape and then recreate
the aggregate file so we essentially have a day's worth of journals on
one tape. It is not exactly a real-time day because of when the job is
run, but since it is run at about the same time every day, it is what I
could call a 'processing' day.

Hope this helps,
Petra
"
IDMS 3rd-party providers forum
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP
IDMSVENDOR-L@LISTSERV.IUASSN.COM
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"we tried this for 5 years - but we had to abandon - throughout the day
on especially on heavy CVs - the offload + append job would take longer
and longer to run as the aggrgate would get bigger and bigger (this was
tape which was probably a mistake) - at times all journals would fill
becuase it took to long to run one offload job and they were of course
singltthreaded

we now offload journals and logs as they fill - and then run an idcams
to get the GDGs created during the day and build a daily tape and then
delete the GDGs just merged

chris

Petra LaFrese wrote:
We use a much simpler method. When offloading journals, we add the
offloaded journal file to an aggregate journal file. Once a day in the
evening backup job, we dump the aggregate file to tape and then recreate
the aggregate file so we essentially have a day's worth of journals on
one tape. It is not exactly a real-time day because of when the job is
run, but since it is run at about the same time every day, it is what I
could call a 'processing' day.

Hope this helps,
Petra
"
IDMS Public Discussion Forum
IDMS-L@LISTSERV.IUASSN.COM
SMTP
IDMS-L@LISTSERV.IUASSN.COM
IDMS-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"due to several direct requests......

the SPECGDGC copy program is an old SHARE user module now distributed via
http://www.cbttape.org/

which contains this http://www.cbttape.org/cbtdowns.htm

in which scroll down to

File 482 GDGCOPY

Rob


Rob Klan/Cincinnati/IBM
Phone: 1-877-205-4871 (T/L: 349-2446)
VOIP Users 1-513-897-8148
ITN: 23492446
Email: rklan@us.ibm.com
"
IDMS 3rd-party providers forum
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP
IDMSVENDOR-L@LISTSERV.IUASSN.COM
IDMSVENDOR-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"due to several direct requests......

the SPECGDGC copy program is an old SHARE user module now distributed via
http://www.cbttape.org/

which contains this http://www.cbttape.org/cbtdowns.htm

in which scroll down to

File 482 GDGCOPY

Rob


Rob Klan/Cincinnati/IBM
Phone: 1-877-205-4871 (T/L: 349-2446)
VOIP Users 1-513-897-8148
ITN: 23492446
Email: rklan@us.ibm.com
"
IDMS Public Discussion Forum
IDMS-L@LISTSERV.IUASSN.COM
SMTP
IDMS-L@LISTSERV.IUASSN.COM
IDMS-L@LISTSERV.IUASSN.COM
SMTP








Normal

Normal
Re: automating journal file concatenation
"We don't do this anymore. It's just too much with 60+ journals a day on
one Production CV and 40+ a day on the other.
We keep all journals 3 days, after that, there's no going back so what's
the point.=20
We have flashcopy backups every day, plus Real Time Global Mirroring,
so, in our evaluation of the various recovery scenarios, when balanced
against the daily overhead and aggravation of merging tapes never to be
accessed again, the ROI just isn't there.
I think the rationale for merging tapes was both to provide a daily
recovery tape and to free up tapes in the library -- but cpu and IO is
precious to us and tapes are cheap -- especially with VTS.

Regards,
dem

Outcomes