1 / 22

CMG 2007

CMG 2007. MXG Vendor Session December 5, 2007 San Diego, California. I. WPS Technical Notes 1. Current Status of MXG testing WPS 2. Run time comparisons 3. Revisions to SAS Clone Article 4. Summary II. Major enhancements in 25.11 since 24.24.

kacia
Download Presentation

CMG 2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CMG 2007 MXG Vendor Session December 5, 2007 San Diego, California

  2. I. WPS Technical Notes • 1. Current Status of MXG testing WPS • 2. Run time comparisons • 3. Revisions to SAS Clone Article • 4. Summary • II. Major enhancements in 25.11 since 24.24. • III. MXG 25.11 is very close to final 25.25.

  3. 1. Current status of MXG testing under WPS Betas in November, 2007. • MXG QA compile-only (dummy INFILEs) TYPExxx and TYPSxxxx members • This exercised the MXG DATA-step Code for compile errors, • and created DOCVER to compare the contents of WPS-built • datasets (variables, LENGTHs, LABELs, FORMATs). • Steps 1 thru 36 of the QAJOBXX were tested. • -Default BUILDPDB with 480MB SMF File • -Tailored BUILDPDB with IMACEXCL with 480 MB SMF File • -TYPETPMX with small file - verified 72 position FORMATs worked. • -TYPENTSM with test file - verified open-system-style MXG code. • WPS Betas were often updated daily, and as errors were • encountered in MXG tests on z/OS and Windows/XP, a new Beta was generated which did correct each error that could be fixed short-term. The current Beta tested was World Programming System 2.02 (02.02.00.08458) of Nov 27.

  4. c. MXG Version 25.11 is required for testing under WPS; its updates eliminate the need for user modifications to MXG Software, and new WPS-specific members (CONFIGW2, MXGWPSV2, JCLINSTW, AUTOEXEW) were added. d. Facilities used by MXG Software not yet in WPS for z/OS: INFILE CCHHR option - needed only for TYPEEREP (EREP,SYS1.LOGREQ) VIEWS - for CPU & I/O performance, used in VMXGSUM. invoked over 60 time in QA BUILDPDB, and in all ASUMxxxx and TRNDxxxx members. Eliminates a full pass of the input data. PROC CONTENTS - minor, does not report High Block Used size. e. Facilities used by MXG Software not yet in WPS for z/OS and Windows: INFILE with ftp access method - performance slower, more disk space SAS/GRAPH, SAS/STAT, SAS/ETS, etc. Currently WPS supports the Base DATA Step Support and a few PROCs, including PRINT, MEANS, CONTENTS, GPLOT, GCHART, with more planned. f. Output differences - minor PROC MEANS printed output - some values printed with one digit more resolution by WPS. - no error in output values spot checked - prevents automated output comparisons

  5. g. Untested - most due to complexity or time to set up multiple inputs: WPS Workbench – Interactive Human Interface – VERY different Uses Eclipse Significant Learning Curve DATA Libraries on TAPE WEEKBLDT, MNTHBLD special TAPE format to DISK, DISP=MOD, etc. TESTTRND, TESTANAL - requires extensive test data ANALxxxx - requires test data ASUMxxxx - except ASUMJOBS, ASUM70PR were tested. UTILxxxx - specialized utilities for MXG Tech Support Internal SORT - on z/OS, internal SAS SORT may be required when BY list variables aren’t in first 4096. NFS Files - not tested. Broken VBS files - not tested.

  6. h. Migration issues - see WPS Migration Instructions: On z/OS, copy all archived SAS Data Libraries on DASD (including HSM migrated) to tape (Sequential) format with the SAS System first. WPS can read SAS Data Libraries in SEQUENTIAL format on tape or DASD. WPS cannot read DASD format SAS Data Libraries i. Customer reports: Several MXG customers have been running their BUILDPDB on z/OS. Early tests had to make source-level-changes to a few MXG members. Most had relatively simple BUILDPDBs with minimal tailoring.

  7. j. MXG Support Position for testing of WPS Release: MXG 25.11 and WPS 2.2 or later are required. Your current MXG Software License Agreement states: Merrill agrees to provide continuous product support for MXG in the following areas: When error conditions (i.e., the SAS® execution of MXG code produces either a return code or an ABEND) are the results of errors in MXG Code, they will be corrected. If you encounter an error testing MXG under WPS: You should report the error to WPS Technical Support for initial investigation. If WPS support believes the error is an MXG problem, they can contact MXG, or may choose to refer you to MXG Support. MXG Support may then request you to send data to MXG: - the raw data file that caused the error - your site's USERID.SOURCLIB (tailoring) source library(s) If the error can be replicated under the SAS System, it will be corrected per our license terms.

  8. 2. Run time comparisons: BUILDPDB,ASUMJOBS,ASUM70PR with 448 MB SMF File z/OS Comparison CPU TCB Elapsed ----------- Compressed ---------------- minutes minutes Work Size PDB Size CICSTRAN Size SAS: 3.88 5.20 209 MB 55 MB 59 MB WPS: 10.67 18.50 233 MB 59 MB 67 MB Windows/XP Comparison SAS: 1.20 2.18 Note 1 65 MB 63 MB WPS: 1.93 2.71 Note 1 78 MB 70 MB z/OS tests were executed on IBM 2094 CPU Model S08, SU_SEC=9708. Windows tests were executed on Intel Duo Core T5500 @ 1.66 GHz. Note 1: Neither WPS nor SAS provide a way to track maximum work space on ASCII

  9. 3. Revisions to SAS Clones article in MXG Technical Newsletter FIFTY: WPS is no longer vapour-ware. The company has bent over backwards to provide corrections. Performance of WPS, when written in JAVA, was so poor (run times were at least ten times worse than the current Beta) that the product no longer uses JAVA, so it cannot exploit ZAAP engines. Items listed in sub-paragraphs i, ii., iii., and iv. have all been addressed to my satisfaction, with the exception of the items that are listed above in this note. Pricing has been significantly reduced from those original IBM prices. As an example, an MXG site in the USA was quoted an IBM price for a 21 Value Unit system (about 1000 MIPS) of $42,000 first year and $8,400 for renewals. WPS can be licensed through IBM or through World Programming; their home page is at http://www.teamwpc.co.uk

  10. 4. Summary: Most of MXG has compiled successfully under WPS on both z/OS and Windows/XP. BUILDPDB has compiled and processed SMF data on both z/OS and Windows/XP. A lot of MXG still needs to be tested with data. WPS is still in development. WPS will roll this Beta into a GA release of WPS 2.2 this week. WPS on z/OS requires thrice the CPU and Elapsed Run Time of SAS. WPS on Windows/XP CPU and run times are similar to SAS run times. Disk Space required on both platforms are similar. So, it is your choice at this time to test MXG under WPS. And, it's your evaluation of your MXG programs that should determine if you believe that WPS is "Ready for Prime Time" at your site, with your current CPU and run times and the MXG programs that you utilize.

  11. 5. QA Steps successfully compiled and executed with dummy input. STEP 3. CREATE FORMAT LIBRARY STEP 4. RUN TESSNT STEP 5. RUN TESSIBM STEP 6. RUN TESSIBM1 STEP 7. RUN TESSIBM2 STEP 8. RUN TESSIBM3 STEP 9. RUN TESSUSER STEP 10. RUN TESSUSR1 STEP 11. RUN TESSOTHR STEP 12. RUN TYPSCMHM STEP 13. RUN BUILDPD3+ASUMS STEP 14. RUN BUILDPDB+ASUMS STEP 15. RUN TYPERMFV STEP 16. RUN TYPECMFV+TYPEMVCI STEP 17. RUN TESSHSM STEP 18. RUN TESSFACO

  12. STEP 20. RUN TESSVM STEP 21. RUN TESSCRAY STEP 22. RUN TESSHPCS STEP 23. RUN TESSUNIA STEP 24. RUN TESSUNIK STEP 25. RUN TESSQAPM STEP 26. RUN TESSQACS STEP 27. RUN TESSTUX STEP 28. RUN TESSPW STEP 29. RUN ASUMPRTR STEP 30. RUN TYPEIMS7 STEP 31. RUN TESSIMSD STEP 32. RUN COPYSTEP STEP 33. RUN TESSTRND - partially completed, not WPS fault. STEP 34. RUN TESSMNTH STEP 35. RERUN TYPE-S FOR NON PROC SORT FOR DATASET LABEL STEP 36. RUN CROSSREF STEP 37. RUN DOCVER - output DOCVER file is identical.

  13. MXG Version 25.11, dated Dec 6, 2007. In 7014 members 2,297,784 lines, creates 4278 datasets, 118,561 variables. Major enhancements added in MXG 25.11. TYPE111 25.241 Support for CICS CTG 7.1.0 new SMF 111 record. TYPE7072 25.224 CPUTYPE tests are replaced with ZARCHMDE tests. This means that with MXG 25.11 or later, a new IBM CPUTYPE will NOT require a new MXG Version. TYPETPMX 25.239 Support for Thruput Manager SLM and DB2 data. TYPE82 25.257 Support for ISCF HCR7750 TKE Logging update. TYPEEVTA 25.255 Support for Action Software's EventAction user SMF. TYPE85 25.234 New variables in OAM subtype 32-35 records. TYPE78 25.236 Zero obs in TYPE78IO with Change 24.171 if z/OS 1.7. TYPEEVTA 25.255 Support for Action Sofware's EventAction SMF record. TYPERMFV 25.246 Updates for CPU Segmentation changes. TYPENTSM 25.253 Support for new NTSMF objects for MSSQL. TYPETNG 25.221 Support for VM Ware VSX Systems in CA NSM records. TYPETNG 25.235 New Solaris, AIX, and many RedHat objects added. VMXGSUM 25.248 New &LNSUMOUT=8 will make all output to length 8. UTILEXCL 25.256 Macro variable &MXGDEBUG revised for IMACEXCL plus! EXITCICS 25.240 MCTSSCRL now tested vs MCTMNOPN for CICS Compressed. TYPE110 25.240 MCTSSCRL now tested vs MCTMNOPN for CICS Compressed. UPRINDOC 25.226 Utility prints NAME and LABEL of all variables. TYPE30 25.260 MXG 25.10, INTRVLTM missing for TYPETASK='OMVS' ANALACTP 25.254 Sample report summarizes DB2 Package data to UOW. CONFIGW2 25.252 MXG updates for testing MXG Execution under WPS.

  14. Major enhancements added in MXG 25.10. TYPE7072 25.205 Support for z/OS 1.9 up to 54 CPUs per MVS,INCOMPAT TYPERMFV 25.204 CFI Segmentation eliminates RMF III skipped CF data. ANALDB2R 25.202 VARIABLE QBnTDPIO NOT FOUND error corrected. TYPE70 25.212 ZIPACTTM, PCTZIPBY corrected for Dedicated zIIPs. ASUMCELP 25.209 Duplicate observations in PDB.ASUMCELP eliminated. TIMEBILD 25.209 Optional SYNC59 timeshifting using TIMETABL. Major enhancements added in MXG 25.09. IMPORTANT CHANGES: Almost none! Only UTILEXCL in 25.08 had an error, but these other fixes/enhancements are now ready for prime time: UTILEXCL 25.193 MXG 25.08 ONLY: LABEL IMACICU3 NOT FOUND. TYPERMFV 25.191 Support for RMF Monitor III CFI table enhancements. TYPESRDF 25.195 Support for EMC's SRDF/A user SMF record. READDB2 25.189 New PDBOUT=YES, old PDBOUT= changed, writes to WORK. ANALDB2R 25.189 New PDBOUT=YES, old PDBOUT= changed, writes to WORK. RMFINTRV 25.199 SMF70GIE now reset to 00/15 if SYNC59=YES is used. TYPE89 25.198 SMF89HOF,SMF89DTO were incorrect due to typo. UTILCSV 25.197 %UTILCSV creates a CSV (or TAB) Delimited flat file. UTILBLDP 25.196 Large &MACKEEP string caused strange results. TYPE92 25.192 New ID=92 ST=14 INPUT EXCEEDED if not a RENAME.

  15. Major enhancements added in MXG 25.08. IMPORTANT CHANGES: TYPETNG 25.181 Support for CA NSM RedHat 4.01 Linux perf cube. TYPE7072 25.176 Support for APAR OA18244, Blocked Workload z/OS 1.9. TYPE7072 25.163 Support for Capacity Groups variables in TYPE70. ASUM70PR 25.163 Capacity Group summarization, PDB.ASUM70GC/ASUM70GL. TYPEQACS 25.178 AS400 APAR QAPMDISK with LRECL=456 added new data. ADOCDB2 25.172 Example to process DB2 datasets to separate DDNAMES. TYPEDB2 25.169 _RDB2ACC DB2 Parallel event "analysis" example. Many 25.179 %UPCASE,%LOWCASE,%STR,%BQUOTE,%QUOTE, etc. Doc 25.179 Use %LET MACxxxx= %STR( text ) ; to pass text. Major enhancements added in MXG 25.07. CRITICAL CHANGE: TYPE78 25.141 APAR OA21799 for HiperPAV, ABEND, SMF78HIX invalid. Installing HyperPAV can create invalid RMF 78-3's that cause BUILDPDB to ABEND as it reads RMF 78's. Change 25.141 will detect bad records and avoid the ABEND, but you will need to install the IBM PTF for the APAR to correct the invalid data values.

  16. IMPORTANT CHANGES/ENHANCEMENTS: Many 25.140 Prelim z/OS 1.9 (fails if 54-CPs, See Ch 25.205) TYPECIMS 25.139 Support for IMF Version 4.3 (INCOMPATIBLE). TYPE74 25.140 APAR OA17070 supports CF Level 15 measurements. TYPE89 25.138 Support for APAR OA20314 new SMF89LPN/SMF89ZNA. TYPE80A 25.137 Support for unknown TOKDANAMs, prevents ABEND. UTILLPDS 25.136 Utility to count used/defined PDS Directory Blocks. TYPE7072 25.135 LCPUCAP/LCPUCAPC Labels include "Hard CAP". TYPE42 25.153 MXG 25.06 only, false INVALID TYPE42 SUBTYPE 5 error. TYPEVMXA 25.151 180 Error _MPRCAPC not found, DEBUG prints removed. ASUM70PR 25.150 ASUM70PR created PCTCPUBY GT 100%, final fix? ASUM70PR 25.150 ASUM70PR now supports INTERVAL/CECINTRV=SHIFT. ADOCITRM 25.149 Doc. Maps ITRM dataset names to MXG name. ADOCDB2 25.148 Doc. How to create DB2ACCTB/DB2ACCTP in separate DDs. ANALRMFR 25.146 ERROR: NO DATASETS TO LOOKUP correction. TYPERMFV 25.145 RMF III dataset ZRBLCP missing obs for many LPARs. UPCMEMDZ 25.144 ASCII utility to determine memory available to MXG. TYPE71 25.143 SWAPrates were set missing if zero, now can be zero. VMXGINIT 25.143 New MXGMISS macro variable changes TYPE71 SWAPrates.

  17. Major enhancements added in MXG 25.06. TYPE30 25.116 MXG 25.05, negative EXECTM, INTRVLTM, GMTOFF30 wrong. TYPE110 25.041 Support for CICS/TS 3.2 (INCOMPATIBLE). EXITCICS 25.041 INFILE Exit for CICS/TS 3.2 SMF record compression. TYPEBTE 25.107 Support for CA Brightstor Tape Encryption SMF. TYPE80A 25.131 Support for CRL PUBLISH and SET UID RACFEVNT 52, 79. TYPEFERT 25.133 Support for Williams Data FERRET product user SMF. TYPECLAR 25.130 Support for Clarion Disk Array flat files. TYPE119 25.119 SMF 119 from z/OS 1.8 caused INVALID DATA messages. TYPESYNC 25.117 INVALID ARGUMENT due to incorrect HEX4/HEX3 formats. ASUMUOW 25.121 Enhanced to keep each CICS segment response time. ASUMHSM 25.113 HSM Summary enhanced with "HSM COMPLEX" HSMPLEX. IHDRIDMS 25.112 CA IDMS PerfMon support enhanced with "IHDR" exit. TYPENMON 25.110 Support for DISKBUSYn for all NMON Disk Monitoring. TYPERACF 25.134 Support for IRRDBU00 record types 0560,0561,0562. TYPE80A 25.131 Support for TOP SECRET (INCOMPAT) '90'x,'00'x VRSN.

  18. MXG Version 25.05, dated Jun 7, 2007. Major enhancements added in MXG 25.05. TYPEITRF 25.103 Support for IBM OMEGAMON TRF ITRF V550 and V560. TYPENMON 25.104 Full support for NMON, Nigel's Monitor for AIX/unix. TYPEDB2 25.090 Support for PK37354 SMF 101 Subtype 4 in DB2 9. TYPEDB2 25.097 Variable THREADTY blank if non-DDF transaction. TYPE30 25.089 GMTOFF30 calculation corrections and problems. CONFIGV9 25.101 MEMLEAVE=10M SORTBLOCKMODE now set in CONFIGV9 UTILBLDP 25.098 %UTILBLDP(BUILDPDB=JES3 ... enhancement.

  19. Major enhancements added in MXG 25.04. TYPE21 25.083 Fix for support for APAR OA20077 Device Bytes TYPE21. TYPEXAM 25.082 Support for XAM Release 3.6, many new data. TYPENMON 25.073 Support for LPAR and IOADAPTR Nigel's NMON data. SYSLOG 25.070 Support for SYSLOG file enhanced, all records output. TYPENDM 25.081 Support for NDM-CD type 'NM' records creates NDMNM. DALYTAPE 25.072 Sample tape reports from STC VTS SMF + MXGTMNT. TYPERMFV 25.079 ZRBLCP dataset had only first LPARs observations. TYPEDB2 25.064 Several QISE variables were wrong. TYPEDB2 25.075 QBGL variables in DB2 V8.1 now supported, were wrong. TYPETMS5 25.084 FILSEQ in TMS.DSNBRECD could be wrong, mult-vol-file. ANALDB2R 25.068 SQL Text QW0141TX was not printed, coding error. UTILBLDP 25.071 Products that need deaccumulation now protected. UTILBLDP 25.065 Default list of ASUMxxx to be included, MXGINCL=. VMXGRMFI 25.069 Service Class Names can be "wild-carded" VMXGUSE 25.067 Revised to invoke _STY70; UTILBLDP recommended. FORMATS 25.063 Additional SWAP reason codes added to $MG079SR. Doc 25.078 List of MXG-issued USER ABEND values & source member.

  20. Major enhancements added in MXG 25.03. CONFIGV8 25.037 SORTEQUALS should NOT have been in CONFIGV8, V9 only. TYPE119 25.035 Support for SMF 119 for z/OS 1.8 (INCOMPATIBLE). TYPE1415 25.047 Support for APAR OA19502, SMF14KET Key Exchange Time TYPE21 25.040 Support for APAR OA20077, uncompress read/write bytes TYPEAIXT 25.039 Support for AIX Tapas-C performance data files. TYPESAMS 25.055 Support for SAMS objects 2151,2226,2229 and 2231. TYPETDS 25.052 Support for TDSLink Version 630 ZCOST datasets. TYPECSM 25.050 Support for CrossSysplexManager user SMF record. TYPSCOCR 25.034 Support for CopyCross (now VTF Mainframe 2.1.0) SMF. VMXGDUR 25.044 Interval= QUARTER, SEMIANN, ANNUAL now supported. TYPEHSM 25.042 Process HSM with different SMF IDs/different SYSTEMs. ASUMTAPE 25.040 Uncompress read/write SMF21DBR/DBW kept in ASUMTAPE. ASUMUOW 25.054 QWACSPCP,QWACTRET added to PDB.ASUMUOW for OTE. ASUMCEC 25.053 PDB.ASUMCEC, PCTCPUBY GT 100%, DURATM LT CECINTRV. BLDSMPDB 25.048 Corrections to BLDSMPDB, new SORTEDBY= option.

  21. Major enhancements added in MXG 25.02. MXG 25.02 was created to protect sites who set the NOSORTEQUALS option (i.e., changed the SORTEQUALS default). NOSORTEQUALS causes invalid data in ASUM70PR-built datasets. CONFIGV9 25.028 OPTION NOSORTEQUALS caused errors in ASUM70PR. VMXG70PR 25.028 OPTION NOSORTEQUALS caused errors in ASUM70PR. Other New Support and corrections added in MXG 25.02: ASMTAPEE 25.033 Support for ASMTAPEE ML-40 assembly under z/OS 1.8. ANALRMFR 25.032 IRD corrections to RMF reports. TYPE42DS 25.030 TYPE42DS had carried-forward IOCOUNT and other vars. TYPE70 25.028 IORATEn per-engine I/Os corrected for IRD. VMXGPRAL 25.028 Print All utility now compares all datasets in LIBs. UCOMPSOE 25.028 Utility to compare SORTEQUALS and NOSORTEQUALS output ANALFIOE 25.026 Divide by zero message protected.

  22. Major enhancements added in MXG 25.01. The MXG 24.24 Annual Version is VERY solid, with only these three relatively minor corrections: TYPENTSM 25.015 INCOMPAT MXG CHANGE for NTSM WEEKly requires action. TYPE7072 25.013 PCTMVSBY in PDB.TYPE70PR was wrong if IRD was active. ASUM70PR 25.001 NRICFCPU,NRIFLCPU were wrong if you have more than 1. Other New Support and corrections added in MXG 25.01: TYPEIMS7 25.006 Support for IMS Version 10 (INCOMPATIBLE) IMS log. TYPEBVIR 25.011 Support for TS7700 SMF records. TYPE7 25.025 Support for APAR OA19453 for 4-byte LOSTRECS count. TYPE74 25.003 NREXPOSR was wrong for HyperPAV devices. EXITCICS 25.017 New "CICS" INFILE EXIT for CICS compressed SMF data. IMACICMR 25.007 Optional CICS CMRDATA, CMDUDATA/CMDDBCCP reversed. IMACICOB 25.008 Optional CICS OMDBDB2LN now spelled as OMBDB2LN. IMACICOM 25.008 Optional CICS OMMLN now spelled as OMMQLN. Please read CHANGESS for the complete list of major enhancements. See member NEWSLTRS or the Newsletters frame at www.mxg.com for current MXG Technical Notes that used to be in CHANGES.

More Related