Knowledge Base

cancel
Showing results for 
Search instead for 
Did you mean: 

Synthetic Scripts FAQ (Part II)

 

Table of Contents:

See also Synthetic Scripts FAQ (Part I).

 

On-Premise/SaaS

 

Question

What are the supported on-prem/SaaS/hybrid configurations?

 

Answer

Controller

Web/Mobile RUM

Synthetic

SaaS

SaaS

SaaS

On-Premise

SaaS

SaaS

On-Premise

On-Premise

Not available

 


 

Security/Passwords

 

Question

Do you have an encrypted store for passwords?

 

Answer

Not at this time.

 


 

Question

Are scripts and test results transferred securely?

 

Answer

The short answer is that scripts and their results always go over encrypted channels. The scripts and results are stored in clear text in various databases, so a database breach could compromise the information, but, of course, we try very hard to prevent database breaches.

For the long answer, see the summary of the data path of a script and its results below. (Foo) denotes data at rest.

  • Script -> UI -> Controller -> EUM SaaS services -> (EUM SaaS database) -> Test driver service.
  • Test driver service connects to PoP machine with an encrypted channel and sends WebDriver commands to the PoP, driving the browser.
  • The browser connects to a website and imitates a user. Instrumentation hook gathers data from browser and sends it to an EUM SaaS service. Now we have a test result.
  • Test result -> EUM SaaS service -> (metric store, event store, and EUM SaaS database) -> controller -> UI.

Each of the -> links uses HTTPS, with two possible exceptions which are determined by the user:

  1. If you use an on-prem controller, security between the browser and controller is your responsibility. In other words, don't allow non-HTTPS connections to your controller.
  2. Security between the test browser and your website is your responsibility. Consequently, your script should connect to your site over HTTPS.

 


 

Question

How can I retrieve passwords from a secure server, not hard-code them in the script?

 

Answer

If you can write Python code to do something using the standard libraries, you can do that in your script. For example, you can use Python's requests library to make REST calls to fetch a password.

 


 

Selecting Elements

 

Question

How do I click on an element in an iFrame (for instance to handle a pop-up)?

 

Answer

You can wait for the iFrame element to be clickable as shown in the snippet below.

from selenium.common.exceptions import TimeoutException
# Cancel an advert pop-up in an iframe
# Find the right iframe
frame = wait.until(EC.element_to_be_clickable((By.XPATH,'//xpath-to-your-iframe]')))
# Move into the iframe
driver.switch_to_frame(frame)
# Close the pop-up
wait.until(EC.element_to_be_clickable((By.XPATH,'/xpath-to-element/i'))).click()
# Move to the default content
driver.switch_to_default_content()

 

 


 

Snapshots

 

Question

What is the retention period of snapshots?

 

Answer

Two weeks.

 


 

Question

Can the retention period of snapshot be extended beyond the default?

 

Answer

No, this cannot currently be extended on SaaS.

 


 

Supported Features

 

Question

Can Synthetics be used for API testing/monitoring?

 

Answer

As of April 2016, API testing is in the long-term vision for Synthetic, but the feature is not on any roadmaps yet.  If the customer's use case involves monitoring the API from inside their network, then Service Availability is the preferred solution.  Monitoring from outside their network is not an option at this time.

 


 

Question

Is virtual page naming (for single page apps) supported in Synthetics?

 

Answer

Virtual pages are not yet supported in Synthetic (possible future feature), so virtual page naming is not supported.

 


 

Question

Are JavaScript popups such as those created with window.alert or window.prompt supported?

 

Answer

Yes, JavaScript popups created with window.alert or window.prompt are fully supported.

 


 

Question

Are multiple windows, as in, multiple HTML documents loading either in different tabs or windows, supported?

 

Answer

Multiple windows or tabs with loaded HTML documents are only partially supported. You can create scripts to handle multiple windows, but the session results will combine the waterfall metrics and the resources from all of the windows into one page. Thus, you will not be able to view the individual results for each browser window.

 


 

 

Troubleshooting

 

Question

How do I debug my script?

 

Answer

We recommend doing your initial debugging locally: that’s always the easiest place to debug. We capture the stdout and stderr streams from your script, so you can debug that way. And we show partial sessions for scripts that failed part-way through, so you can see what the browser did up until the script failed.

 

Question

How do you prevent timeouts in scripts?

 

Answer

Timeouts in scripts can be prevented by explicitly waiting for specific element states (e.g., clickable). See also the paragraph Expected Conditions discussed in Explicit Waits.

 


 

Question

If something breaks, how can I tell if it’s my site, my job, or your infrastructure?

 

Answer

If your script has an assertion failure, the session status is “Failed”, which indicates a problem with your site. If your script crashes, the session status is “Broken”, which indicates a problem with your script. If we can’t run your script, the session status is “Internal Error”. We hope you’ll never see that. For single-URL measurements, a 5xx is “Failed,” and a 4xx is “Broken”.

 


 

Question

Why are visual metrics (Visually Complete, Speed Index) not always present?

 

Answer

There are currently two known issues regarding visual metrics:

  • In some cases, Chrome sessions may not display visual metrics because of a bug. This typically happens on pages with JS redirects, but may happen elsewhere as well. This is a Chrome-specific problem, and we are working on a solution.
  • A Windows issue will sometimes prevent these metrics to be computed for all browsers. When this happens, the agent needs to be rebooted. This is infrequent because we get alerts and react as fast as possible.

 


 

Version history
Revision #:
2 of 2
Last update:
3 weeks ago
Updated by:
 
Contributors
0 Kudos