Skip navigation
All Places > DevTest Community > Blog
1 2 3 4 5 Previous Next

DevTest Community

233 posts

The Continuous Validation Service in CA Application Test orchestrates the testing and validation aspects of IT, Integration workflows, and SOA Governance, to ensure reliability and instill trust throughout the lifecycle of the application. CA Application Test is part of CA’s DevTest Framework and conducts live regression, functional and performance monitoring of critical business workflows on a continuous basis, providing an actionable way to enforce that expected business policies are being met.

The Challenge: Solving the Unintended Consequences of Change in Enterprise Apps

Distributed enterprise applications will naturally evolve over time, as they leverage highly interdependent and changing services and technologies, which are assembled to build the finished application at runtime. Continuous integration is moving from a best practice to a do-or-die IT tactic. With so many heterogeneous components working together as an application, there is no specified "release date" for a new BPM process flow, or a new build of the components underlying your enterprise applications. When a service is added or changed, it has the potential to cause a "ripple effect" on other dependent upstream and downstream workflows.

 

In order to manage the business risk of this change, companies seek to employ IT Governance practices, to ensure that Management, Policy and Testing are all incorporated into the application development and deployment strategy. CA Application’s Test "Always On" testing provides a key enabler for quality, ensuring that expected Policies and business requirements are reliably met.

How the Continuous Validation Service Works

The Continuous Validation Service in CA Application Test can be used as a shared provider of both scheduled and event-based regression and performance test suites. When a change to an underlying application is made, when a new service is promoted for use, or if an unexpected error or performance expectation is not met, CA Application Test can communicate with the enterprise's stakeholders, or report this activity to an SOA governance, ALM collaboration tool, or IT monitoring platform.

 

 

With Continuous Validation in your environment, you gain a strategy for mitigating risk in your enterprise applications at build time, run time and change time, bridging the trust gap between Governance initiatives, and the actual software development and deployment lifecycle.

Benefits

Thorough, repeatable validation and testing that runs according to your process, and takes your entire extended application into account, pays measurable dividends: avoided failures, reduced testing and release costs, alignment of IT with business goals and policies, and best of all a good night's sleep.

 

  • For integration activities, instead of having to figure out if a given build succeeded or failed by poring through unit tests that might provide little result data, the CA Application Test can report detailed conditions directly to the tester or governance platform as a gateway for the release. This protects the integrity of the existing workflows already in play, and drastically accelerates the process of build/adjust during release thanks to Application Test’s deep contextual feedback to the developer.
  •  For live deployed applications, CA Application Test provides extreme visibility into the entire SOA architecture, both at a component and system-wide level, as it continually evolves. The ability to manage such extensive and detailed test suites, with a project hierarchy for flexibly building and scheduling test processes, with automated dashboards for stakeholders to use, creates an easy to use collaborative system for enterprise quality teams. 
  • For governance practices, deeply enhanced dynamic test registry and test suite management tools give your team an actionable set of verification assets, thereby ensuring that SOA Policies for the compliance and behavioral needs of the business are actually being met by the combined services


What is the cost of application failure in your mission-critical applications? Mandating a Policy or a Service Level Agreement is a great way to start, but real functional and performance verification with CA Application Test is where the rubber meets the road. CA Application Test can provide you with a picture of the health of your Critical Software on a continuous basis, which is what you need if you are relying on mission-critical enterprise applications.

To learn how to use the Continuous Validation Service go to:
https://docops.ca.com/devtest-solutions/10-0/en/using/using-ca-application-test/using-devtest-portal-with-ca-application-test/monitor-with-cvs-continuous-validation-service

 

Invoke and verify is a term unique to CA Application Test and refers to the products ability to test and validate response across all layers of an applications with a single test. This unique ability makes CA Application Test a great fit for organizations that need to test applications that must work with legacy systems, custom applications, ESBs and back-end databases. For example, if we want to check that an order was placed from a Mobile device under test, we may look within an enterprise service or Order Management System to validate the proper order entry - only when these two/three validations are complete can we state that we have validated the functionality.

 

In CA Application Test, API and non-API tests are created in the same way, using a code-less visual designer, one test can include API and non-API tests. SOAP, REST, general HTTP based APIs, JMS Messaging, Java, and more are supported. Users can model a single test case with steps that invoke and verify an API’s behavior and performance, as well as validate database calls, SOAP messages and many more types of transaction Test can contain a mix of any type of underlying technology step types, across any number of APIs.

 

  1. First, Application Test Connects to an object on the application server, or over the Internet.
  2. Next, Application Test Gathers information about the component, showing you available methods for interacting with it.
  3. Then, you can Invoke, or the target system with a method, to create a result.
  4. CA Application Test then gets the Response from that object as a behavior - so you can make a test assertion against that behavior as part of your testing process.
  5. CA Application Test can then React to that response and invokes the next step in the testing workflow.

 

Since CA Application Test is an integrated testing suite, the value of Functional Tests continues, and tests are Reused in other processes. For instance, you can save the response data within a database, use that data to validate the behavior of another component or sequence of steps, save that functional test sequence as part of a business workflow, check the workflow in deployment at load, and then monitor its performance within a set of workflows... the list goes on.

 

To learn how to use the invoke ability in CA Application Test 10.0 visit:

https://docops.ca.com/devtest-solutions/10-0/en/using/using-ca-application-test/using-devtest-workstation-with-ca-application-test/running-test-cases-and-suites/lisa-invoke

 

To see a quick tour of CA Application Test visit:

https://youtu.be/BAPRlADX8qQ

Test Data represents a significant challenge for many QA and development teams resulting in time-consuming manual testing efforts, excessive costs and slipped delivery dates.  CA Service Virtualization can automate the creation and management of test data by capturing and manipulating virtualized datasets from messaging streams and data sources. These unique capabilities help eliminate test data conflicts between teams and drives lower costs and manual effort.


Common Test Data Management Challenges Include

 

  • Manual Test Data Management. Modern, distributed applications require test data to be created and synchronized across multiple systems, consuming significant time and manual effort. Accessibility constraints can make test data synchronization an almost impossible task, prompting testers to skip or reduce test scenarios.
  • Data Volatility. Systems under test often run against systems that are in production or shared by other teams. This causes the data to be volatile (changing randomly and often), making validation of results against these volatile systems difficult or impossible.
  • Data Sensitivity. Use of production data is limited by the need to obscure sensitive information such as account and social security numbers, and can present a significant compliance challenge, particularly when offshore or outsourcing service providers are used.
  • Impact on Production Systems. Some test scenarios create transactions that impact data in production systems. For instance, if a test places an order, the order then needs to be traced and deleted. This incurs time and costs on both testing and operational staff and can disrupt business operations if not carefully manage

 

Virtual Test Data as a Solution

 

CA Service Virtualization provides an automated approach to capturing, modeling, desensitizing and maintaining virtual test data across multiple services, integration layers and systems of record.

 

  • Virtual Dataset Creation: CA Service Virtualization listens and captures data as it flows across all application tiers and technologies to generate a robust virtual data set with a high level of functional accuracy. Test data can also be imported from databases (JDBC, SQL), Excel spreadsheets, flat files, log files, or XML sources.
  • Test Data Manipulation: CA Application Test makes it easy for testers to modify datasets and chain them together into scenarios. Data models can be created and edited within CA Application Test in a point-and-click environment with rules applied for randomization, sequencing or appending of additional data sources. Or, manipulate data in familiar tools of choice such as spreadsheets.
  • Test Data Masking: Sensitive live data can be obfuscated and automatically processed by CA Service Virtualization into "safe test data" that is valid for testing activities without violating regulatory or security policies.
  • Dynamic Data Stabilization: CA Service Virtualization can stabilize test data so that test scenarios are validated according to expected business rules. This includes maintaining the relevance of variables including changing dates, currency conversions, customer session information and sequential data entry steps.
  • Data Model Self-Healing: CA Service Virtualization can "self-heal" virtual test data sets by validating and recapturing relevant data from live sources or transaction streams on a scheduled or exception basis, increasing the long-term viability of virtual test data and minimizing the need to correct or update data manually.

 

CA Service Virtualization Benefits for Managing Test Data across Modern Applications

 

  • Reduced time and cost. Synchronization of test data across multiple dependent systems can be automated with LISA. Testers can now capture and build robust virtual data sets that automatically self-update for longer term use.
  • Eliminates constraints from the software lifecycle. Robust virtual datasets can be leveraged by multiple teams, enabling parallel development and testing activities without dependencies on live systems or conflicts over the use of shared test data.
  • Security and compliance. Automated masking of sensitive data allows testing to proceed without exposing data to unauthorized users or processes.
  • Reduced impact on live systems. Virtual datasets allow you to avoid accessing production systems to insert, update or delete test data.  Test data requests can be routed to virtual data sets or live systems in conjunction with exiting Application Lifecycle Management (ALM), Test Management (TM), and SOA Registry/Repositories as appropriate.

 

 

CA also offers a comprehensive Test Data Management solution – CA Test Data Manager. To understand when to use CA Service Virtualization vs. CA Test Data Manager read the blog: “CA Service Virtualization meets Grid-Tools – CA Data Finder how will they get along”.

CA Service Virtualization /CA Application Test

We are pleased to announce that DevTest 10.0 including CA Service Virtualization and CA Application Test is generally available (GA) as of December 21, 2016.  We have a lot of new and exciting features in 10.0.  Below are the highlights in our new release.  Keep an eye out for additional videos, how-to's and best practices as we head into the new year.

 

CA Service Virtualization 10.0 Highlights:

  • New workflows for creating tests
    • From an existing Virtual Service 
    • SWAGGER 2.0
    • WSDL 
    • RR Pairs
  • Updated support for Virtual Services created from SWAGGER 2.0
  • VS Config to change HTTP configuration of existing VS’s in the DevTest Portal
  • Integration API for automating VS creation in SWAGGER 2.0
  • New Integration with CA API Management- Capture the request and response data for APIs that are managed by CA API Gateway. Then create baselines and virtual services for the APIs. (CAI)
  • Mainframe Enhancements
    • Mainframe Transaction Virtualization with full agent configuration, transaction creation and virtual service creation right in the DevTest Portal. 
    • CICS Virtual Service Recording and Copybook Bundles in the DevTest Portal
    • Added support for CICS transactions that contain fragmented comm areas and CICS LINK Temporary Storage Queues (TSQ)
    • Support for CTG 9.2 and below
    • Mainframe Support for CICS in Portal from Capture
    • Added transaction lists to Copybook Mapping Tab

CA Application Test 10.0 Highlights:

  • Import and Create tests in Swagger 2.0
  • New Integration with Agile Central (Rally) automatically sync test run results from the DevTest Portal to the CA Agile Central tool.
  • New HP ALM Plugin for DevTest 64-Bit so that you can load and run a CA Application Test test case as a Quality Center test from the HP Quality Center suite.
  • New Coordinator and Simulator views in the DevTest Portal

 

Related Links (Be sure to check back after the new year for additional links, instructions and videos)

 

CA DevTest 10.0 Release Notes

CA DevTest 10.0 Product Documentation

Top Ten Reasons to use DevTest 10.0 from CA World

Business

AusNet Services is Victoria’s largest energy business, delivering electricity and gas to homes and businesses across the state.

 

Challenge

For energy companies such as AusNet Services, business outages are not an option. To keep its operations running, the company must ensure its complex IT systems are available 24x7.

 

Solution

AusNet Services uses CA Service Virtualization to virtualize its heavily integrated systems, enabling comprehensive testing before any upgrade goes live.

 

Benefit

CA Service Virtualization has enabled AusNet Services to take a test-driven approach to development, with developers responsible for creating their own test cases. This means testing starts much earlier in the development cycle, reducing the volume and impact of defects.

 

Read the full story here: AusNet Services Minimizes Disruption from System Upgrades with CA Service Virtualization - CA Technologies 

During the month of July 2016, here are the updates to ideas. The goal of these monthly updates is to give you one place each month to see which ideas statuses have changed so that you can focus your attention to the updates that may be important to you and your team.

 

The list below is sorted by the status and then the category or product. For details on why the status was changed, just click on the link to the idea and check out our comments and notes.

 

Delivered: These features are GA! Comment on them to tell us what you think of them.

Currently Planned - We have these in our backlog as a high priority and our team is working to get them into the next major or minor release. Your comments are valuable here as we're in the process of building.

Wish Listed - We agree these are important ideas but either need more information or don't have it planned yet for a release. We've placed it in our agile backlog for prioritization. Vote for these ideas to move them up the priority list!

 

Not Planned - We don't feel these ideas are aligned to our product strategy. They are not planned for now or future.

Thank you to everyone who joined this webcast on July 28, 2016 which featured a presentation on CA Service Virtualization, CA CAI and CA Application Test 9.5. A big thanks to Chris_Kraus and Anand_AK_Kameswaran for presenting this topic to the community!

 

Below are all the relevant webcast materials:

It's that time of year again: Registration for CA World '16 is now open!!

 

The CA World team has done an amazing job building upon the success of last year's event, and enhancing the programming in response to your feedback. CA World is your opportunity to gain valuable, actionable knowledge and insights to help your company get an advantage in the application economy. New this year, attendees will enjoy:

 

  • 100% More Pre-Conference Education
  • CA Agile Academy with related certifications
  • CA Agile Bootcamp
  • CA Product Certification
  • Design Zone
  • Innovation Exchange
  • Development Track


The session catalog will go live in August, but in the meantime, you can visit the CA World '16 website to explore the Pre-Conference Education, learn Why You Should Attend and to View the Agenda.

 

Ready to join us November 14-18 in Las Vegas, Nevada?

Register by September 16 and get our Super Saver rate of $1,295. That's a $700 savings off our regular rate!

 

CA World Alumni: Look for an email with a code for a special discounted rate of $1,000

 

And as always, stay tuned to the CA World '18 for the latest info on all things CA World!

Due to issues found after the release of 9.5, today we released build 9.5.1 to GA.

 

9.5.1 is being replicated now and will be posted to support.ca.com in the next few hours (you may see it now depending on your region). 9.5.1 will replace 9.5 and we will remove the 9.5 release from the support site tomorrow morning (after 9.5.1 replication is complete).

 

When we refer to 9.5 in future posts, we'll be referring to the 9.5.1 build so those who are using 9.5 today are encouraged to replace with 9.5.1 as soon as possible to alleviate any issues or confusion.

 

The changes/fixes in 9.5.1 are published here: https://docops.ca.com/devtest-solutions/9-5/en/release-notes/resolved-issues-for-9-5-1

 

Also, ICYMI, Video Demos of the new features in 9.5 are now available on this YouTube Playlist

Upcoming Events

DevTest Community Webcast - What's New in Test Data Manager 3.6 - July 21 at 11am ET

WebCast - Intro to Performance Testing with Service Virtualization - July 26 at 2:30pm ET

DevTest Community Webcast - Overview of Service Virtualization 9.5 - July 28 at 11am ET

 

Product Announcements

DevTest 9.5 is Generally Available (GA)

 

Noteworthy Content

DevTest Ideas: Monthly Update - July 2016

What are you doing here?!? - take this poll to help us customize community content!

Are you receiving the latest DevTest news? Subscribe to the Continuous Delivery Newsletter!

Manheim Accelerates Systems Testing & Business Transformation with CA Test Data Manager !

Putting the ‘T’ back into TDM

 

New Tech Tips

Tech Tips: Download DevTest Software

DevTest Architecture Best Practice - Use Case #3 

Tech Tips: DevTest Performance Tuning

 

New Ideas

Provide Better Error Message

Add notification functionality directly to VSE for Virtual Service going down

Assertions which set at the 'Execute Subprocess Step(s)'

Add a filtering function to the CVS Dashboard

META response for a Data Driven signature/transaction.  

FDM connectivity to SQL Server with Forced Encryption

HASHING on SUBSTRING or CONCATENATED VALUES in FDM

In portal show the condition triggered within the audit document failing the testsuite

Test Step to interact with Apache kafka

CA DevTest Language Support

 

Recently Answered Questions

Help! With DevTest 9.1, getting java.lang.ClassCastException:

How to manage/document request and responses in the VSE-Image?

DevTest9.1 Concurrent capacity disabled

Installing DevTest9.1 LDAP,Registry

REST API using Swagger

Issue in using beanshell with QC / ALM Integration

What VS model style lends itself for load and performance testing? 2.Running a virtual service using a more efficient…

Is Virtual Service Causing Read Timed Out Exception

-- UPDATED -- Does recording process change Authorization Header?

 

Was this helpful? Is there content you were looking for that's NOT in here? Leave your feedback in the comments section!

This blog post will highlight the helpful users in the DevTest Community who have answered questions in the past 2 weeks and provide a list of targeted questions for the upcoming 2 weeks. Will you be highlighted in the next blog post?

 

Shout-out to the following members who helped out by answering a question in the community in the past few weeks:

 

Think you have a potential answer? Jump in! Here is the list of unanswered questions:

Customers often ask “Where do we Start” when setting up and configuring their DevTest architecture. Of course, this really depends on how they plan to use DevTest - whether using Virtual Services or running tests or maybe a combination of both. So based on potential usage of DevTest, we started building a Best Practice Architecture Guide based on real world deployments.  As a part of this initiative, we will build out several architectures that are implemented by either customers or CA Services or are new/tested architectures that fit a specific need.

Our intention is to provide options for customers, partners and CA Services on how to implement DevTest within their environment to meet the specific use cases.

 

 

This third use case walks through setting up DevTest 9.1 in Microsoft® Azure environment for multiple teams that do not work on a common project, but need segregated and separate resources to create, test and operate automated tests and virtual services.

 

ScreenShot392.jpg

 

Again and as always, comments and feedback are welcome (Koustubh.Warty, Ulrich_Vogt).

 

 

So far following detailed DevTest Architecture Best Practice Guides have been published:

 

Here's our second installment of the monthly DevTest Idea update. The goal of these monthly updates is to give you one place each month to see which ideas statuses have changed so that you can focus your attention to the updates that may be important to you and your team.

 

The list below is sorted by the status and then the category or product. For details on why the status was changed, just click on the link to the idea and check out our comments and notes.

 

Delivered: These features are GA! Comment on them to tell us what you think of them.

 

Currently Planned - We have these in our backlog as a high priority and our team is working to get them into the next major or minor release. Your comments are valuable here as we're in the process of building.

 

Wish Listed - We agree these are important ideas but either need more information or don't have it planned yet for a release. We've placed it in our agile backlog for prioritization. Vote for these ideas to move them up the priority list!

 

Under Review - We're researching, need more information from you or haven't yet dug deep into these ideas. Help us gain clarity by adding your comments and use cases.

 

Not Planned - We don't feel these ideas are aligned to our product strategy. They are not planned for now or future.

CA Service Virtualization /CA Application Test/ CA Application Insight 9.5

 

We are pleased to announce that DevTest 9.5 including CA Service Virtualization, CA Application Test and CA Continuous Application Insight 9.5 is generally available (GA) as of June 29, 2016.  This release includes some really awesome integrations with CA Agile Central (Rally) and CA API Management. We did an uplift on our Mainframe capabilities too, both adding functionality to SV in the DevTest Portal and putting in enhancements for users of CA CAI. In addition, we removed the old Server Console and replaced that functionality in the DevTest Portal.

 

1 old UI Down, 1 more to go!

 

Here is a summary of the key functionality introduced in DevTest 9.5:

 

CA Application Test 9.5

 

CA Continuous Application Insight 9.5

  • New Integration with CA API Management - CA CAI lets you capture the request and response data for APIs that are managed by CA API Gateway. You can then use CAI to create baselines and virtual services for the APIs.
  • New Mainframe Transaction Virtualization with full agent configuration, transaction creation and virtual service creation right in the DevTest Portal.

 

CA Service Virtualization 9.5

  • Mainframe Support Enhancements including:

  • New SandBox Feature: Virtual Service Configuration added to the DevTest Portal so that you can (1) change the HTTP configuration of existing virtual services (host, port, SSL settings) after they've been created and (2) change the DPH settings for SOAP, JSON v2 and XML transactions. You no longer need to open up the DevTest workstation to modify the Virtual Service Model OR re-record a virtual service to make a simple change to endpoints or data protocol handlers.

  • New SandBox Feature: Create a Virtual Service from Request/Response Pairs with editing capability along the way including:

      • New Workflow to Create Virtual Services from Request/Response Pairs so that you can view the transactions, edit them, add new RR pairs, and delete from the list before finishing out the steps to create the virtual service.

      • Automatic creation of a virtual service image and model within a requested project -- you no longer need to download a MAR file, upload it into a project and open it up to be able to edit the virtual service you just created.

 

Common Components

 

Related Links