Spy Phone Review’s testing methodology

Testing spy phone software is hard work but it is also fun and rewarding as well because we get to see which spy phone software really is the best and which ones are scams or are simply being dishonest.  FlexiSPY has its own labs which it uses to test not only its own software and compatible devices but also its competitors to make sure that FlexiSPY provides you the best spy phone software available.

But what exactly goes on inside the testing process?

Essentially it is just a huge checklist and we have given you this below.  All of these elements are tested thoroughly on each phone platform and then documented and only when it passes the strict FlexiSPY Labs testing protocol do we deem a feature compatible on a certain phone or a certain phone compatible with FlexiSPY.

Testing usually takes up to a week at least and everything is written down and passed to our dedicated test team and developers to help shape the future of the software.  We then provide the same strict testing protocols to other spy phone software and, if our reviews are anything to go by, they do not meet the high level of standards and expectations that FlexiSPY Labs expects from competing spy phone software after decades of testing and working with FlexiSPY.

Here is the entire FlexiSPY Labs testing methodology below taken from confidential FlexiSPY Labs test results.

Software installation and visibility

  • Is the software accessed on the TARGET device using a browser?
  • Is a computer required to log in to the online dashboard to view installation details?
  • Is the software accessed on the TARGET device by dialing a special code?
  • Is the software accessed on the TARGET device by using a specific application?
  • Can the secret code used to access the software be changed?
  • Is it displayed on the springboard/apps list?
  • Does the software require internet for installation?
  • Does the software require internet for activation?
  • Does the software require internet to be accessed once installed?
  • Does the software require a SIM card for installation?
  • Does the software require a SIM card for activation?
  • Can the software be installed and still work if the TARGET device SIM card is changed?
  • Is the software license for one device only?
  • Does it appear under Manage Applications?
  • Is it discovered by task killers?
  • Is it discovered by antivirus?
  • Is it shown as a running application?
  • Does it hide traces of rooting/jailbreaking?
  • Can you remove all traces of installation?
  • Is any trace left in the call logs?
  • Is any trace left in the browser?
  • Does the device reset after accessing the software and making changes?
  • Does the device need to be jailbroken for all features to work?
  • Does the device need to be rooted for all features to work?
  • Are certain features network provider specific?
  • Are certain features platform specific?
  • Can one installation file work on all platforms (polymorphic)?
  • Does the software inform you via SMS if the TARGET device SIM card is changed?
  • Can the software be moved from one device to another?
  • Does moving between devices require physical access to the device?
  • Can you visually see when data is being uploaded from the device (e.g. 3G icon appears)?
  • Can you visually see when GPS data is being uploaded from the device (e.g. GPS icon appears)?

Software dashboard (Logging in)

  • Can it be logged in to on a smartphone?
  • Can it be logged in to on a tablet?
  • Can it be logged in to on a PC?
  • Can it be logged in to on a Mac?
  • Does it work in Firefox?
  • Does it work in Google Chrome?
  • Does it work in Internet Explorer?
  • Does it work in Opera?
  • Does it require a username and password to log in?
  • Is the login page a secure connection (https)?
  • Can you retrieve a lost password?
  • Can you retrieve a lost username?

Software dashboard (Logged in)

  • Are all page elements loaded properly?
  • Is there a session timeout limit (logged out after no activity during a set period)?
  • Are all links clickable?
  • Do all mouseover events work?
  • Are data categories clearly labeled and easy to access?
  • Do the pages scale to the computer screen being used (resolution)?
  • Do all pages take you to the correct location when clicked?
  • Does the page require additional software for content (Java, Flash etc.)?
  • Can you contact Live Support once logged in?
  • Can you find software documentation to get started?
  • Is there an installation wizard to guide you through the installation?
  • Is the dashboard in multiple languages?
  • Can you download all account data?
  • Can you delete all account data?
  • Can data be exported as PDF?
  • Can data be exported as TXT?
  • Can data be exported as XLS?
  • Can data be exported as CSV?
  • Can data be searched through?
  • Can data be searched to through a specific date range?
  • Can you easily see when new data has been uploaded?
  • Can you force the dashboard to sync new logs?
  • Can you send commands to the TARGET phone from the dashboard?
  • If commands can be sent to the TARGET phone from the dashboard does it use internet (PCC)?
  • If commands can be sent to the TARGET phone from the dashboard do you use your own phone?
  • Can you uninstall the software from the dashboard?
  • Can you easily access important information such as license details?
  • Does exported data include pictures?
  • Does data exported include videos?
  • Is data exported text only?
  • Is data exported correctly formatted?
  • Is data regularly purged by the company?
  • Do you have a quote for the storage of online data?
  • Does it show battery usage and give reminders if low?
  • Does it give battery reminders if you set event capturing to be too frequent?
  • Does it show current sync status?
  • Does it show last sync status?
  • Does it show sync status in realtime?
  • Can you see the status of all commands sent from the dashboard to the device?
  • Are the commands sent from the dashboard to the device processed immediately?
  • Can events be flagged if they are important?
  • Can alerts be set for SMS data containing specific keywords?
  • Can alerts be set for IM data containing specific keywords?
  • Can alerts be set for email data containing specific keywords?
  • Can alerts be set for MMS data containing specific keywords?
  • Can alerts be set for calls from certain numbers (incoming/outgoing/missed/withheld)?
  • Can alerts be set for SMS from certain numbers (incoming/outgoing/withheld)?
  • Can alerts be set for MMS from certain numbers (incoming/outgoing/withheld)?
  • Can alerts be set for when the device is in a certain location?
  • Does the software correctly identify the software version purchased during the installation process?
  • Can the software be uninstalled remotely from the dashboard?
  • Can you view the screen of the device in realtime?
  • Can dashboard data be searched through by phone calls for a specific keyword and date range?
  • Can dashboard data be searched through by SMS for a specific keyword and date range?
  • Can dashboard data be searched through by Email for a specific keyword and date range?
  • Can dashboard data be searched through by IM for a specific keyword and date range per IM application?
  • Can dashboard data be searched through by MMS for a specific keyword and date range?
  • Can dashboard data be searched through by websites visited for a specific keyword and date range?
  • Can dashboard data be searched through by Notes for a specific keyword and date range?

Data capturing ability and performance

  • Can data be downloaded to be viewed offline from web account?
  • Can data be filtered per day/week/month etc. from web account?
  • Can important data be flagged from web account?
  • Can the data upload timer be changed?
  • Can you upload data by a number of events instead of a timer (either/or)?
  • Can you set the number of events to trigger data upload?
  • Can connection methods to upload (3G, wifi, GPRS) be changed or set?
  • Is the data uploaded in real-time or a timer?
  • Can you visually see when data has been uploaded inside the dashboard?

SMS

  • Does it capture SMS messages?
  • How accurate? (number of missed ones vs. actual)
  • Does it capture SMS messages if they are deleted from the phone?
  • Are SMS conversations viewed as threads?

MMS

  • Does it capture MMS messages (text and media)?
  • How accurate? (number of missed ones vs. actual)
  • Does it capture MMS messages if they are deleted from the phone?
  • Are MMS conversations viewed as threads?

IM

Facebook

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone?
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • How long does it take for captured data to be uploaded?

Viber

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone?
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • How long does it take for captured data to be uploaded?

Whatsapp

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone? Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • Is Whatsapp data uploaded constantly (rooted)?
    • Is Whatsapp data uploaded once a day (non-rooted)?
    • How long does it take for captured data to be uploaded?

LINE

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone?
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • How long does it take for captured data to be uploaded?

Skype

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone?
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • Does it capture video calls?
    • Does it capture video chats?
    • How long does it take for captured data to be uploaded?

Wechat

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • How long does it take for captured data to be uploaded?

IMessage

  • Does it support the latest version?
  • Does the software update itself if Facebook is updated?
    • Does it capture IM messages?
    • How accurate (number of missed ones vs actual/is any IM content not captured)
    • Does it capture IM messages if they are deleted from the phone
    • Does it capture contact name?
    • Does it capture contact picture?
    • Does it capture stickers?
    • Does it capture emoticons?
    • Does it capture group chats?
    • Does it capture attachments (files)?
    • Does it capture attachments (video)?
    • Does it capture attachments (audio)?
    • How long does it take for captured data to be uploaded?

GPS

  • Does it capture GPS?
  • How accurate?
  • Can GPS method used be changed?
  • Does it work if location services are turned off?
  • Does it use cell ID?
  • How much data is consumed to upload the location data vs. data payload?
  • Can you view location data from a specific date range?
  • Is GPS data correctly plotted on a map?
  • Does it allow for GPS ranges to be set (geofencing)?
  • Are you alerted if target device exceeds GPS range?

Images

  • Does it capture images stored on the phone (e.g. photos)?
  • Does it capture images saved by the browser?
  • Does it capture images saved in IM (e.g. Facebook)?
  • How long does it take to upload?
  • Is it full size or thumbnail?
  • How much data is consumed to upload the pictures vs. data payload?
  • Can images be downloaded from web account to view on PC?
  • Is this feature enabled upon installation?

Video

  • Does it capture actual video files (e.g. AVI)?
  • Does it capture video files created (e.g. from camera)?
  • Do the video files remain on the device once captured?
  • How long does it take to upload?
  • How much data is consumed to upload the video vs. data payload?

Audio

  • Does it capture audio files created (e.g. from memo app)?
  • Do the audio files remain on the device once captured?
  • How long does it take to upload?
  • How much data is consumed to upload the audio vs. data payload?
  • Are ambient recordings stored in the online account?
  • Are ambient recordings stored as MP4, 3GP, AMR?
  • Can ambient recordings be listened to from within the online account?
  • Does it capture actual audio files on the device (e.g. MP3)?
  • Does it capture live calls?
  • Are live calls stored as MP4, 3GP, AMR?

Email

  • Does it capture emails from all clients?
  • What email clients are available? (Gmail/Yahoo/Exchange etc.)
  • Does it capture text only?
  • Does it capture HTML emails?
  • Does it capture attachments?

Browsing activity

  • Does it capture Safari browser data?
  • Does it capture Chrome browser data?
  • Does it capture Opera browser data?
  • Does it capture browser data in private browsing?
  • Does it capture bookmarks?
  • Does it capture bookmarks not stored in the default bookmarks folder?

Address book

  • Does it capture the contact name?
  • Does it capture the contact number?
  • Does it capture the contact image?
  • Does it capture contacts that are deleted after software is installed?
  • Does the software update new contact details accordingly?
  • Does the software make sure that blank contacts are not captured if data is present?
  • Does the software capture the contact name correctly across multiple areas (address book, IM etc.)?

Calendar

  • Does it capture all calendar tasks on the phone after installation?
  • Can you see individual task details? (e.g. attendees, time, location)
  • Does it capture recurring events?
  • Does it capture the main calendar only?
  • Does it capture multiple calendars?

Tasks

  • Does it capture all tasks on the phone after installation?
  • Can you see individual task details? (e.g. attendees, time, location)
  • Does it capture recurring events?

Notes

  • Does it capture all notes on the phone after installation?
  • Can you see individual note details?
  • If existing notes are saved and edited are they updated accordingly?
  • Does it capture audio notes?
  • Does it capture note attachments?
  • Does it capture pictures inside a note?
  • Does it capture voice attachments inside a note?

Installed applications

  • Does it capture installed applications?
  • Are all applications listed (e.g. Cydia)?
  • Does it capture itself as an installed app?
  • Does it show which apps are running?
  • Does it show which apps are stopped?
  • Does it show if an app is uninstalled?
  • Can you monitor app usage over a time period (e.g. most popular app used that week to spot trends)?

Wallpaper

  • Does it capture device wallpaper?
  • Does it capture camera images set as wallpaper?
  • Does it capture wallpaper not stored in the default folder?

Call Intercept

  • Does the software allow for live calls to be intercepted?
  • Can you intercept all calls?
  • Can you intercept calls in a list that is user specified?
  • Do any beeps occur when call intercept is in progress?
  • Do any on-screen notification appear when call intercept is in progress?
  • Do all three calls need to be merged before call intercept can take place?
  • Does call intercept require three way calling enabled on the target device network provider plan?
  • Do you need to mute your own phone to avoid being heard?

Spycall

  • Can you listen to the surrounding area?
  • Does this work if the phone is in use?
  • Does the phone light up when spycall is in progress?
  • Does the phone make sound when spycall is in progress?
  • Are you notified if the phone is in use when you try to perform spycall?
  • If spycall cannot be performed can you listen to the live conversation instead at that time?
  • Do you need to mute your own phone to avoid being heard?

Call Recording

  • Does the software allow for live call to be recorded?
  • Can you record all calls?
  • Are you notified when recording is in progress?
  • Can you see the status of the recording?
  • Can you record in a list that is user specified?
  • Are recorded calls saved in to the online dashboard?
  • Can recorded calls be played inside the online dashboard?
  • Can recorded calls be played on a computer?
  • Are recordings in the preferred AMR format

Ambient Recording

  • Does the software allow for spycalls to be recorded?
  • Can you specify the duration in minutes to record?
  • Are you notified when recording is in progress?
  • Can you see the status of the recording?
  • Does this work if the phone is in use?
  • Does the phone light up or make any sound?
  • Are recorded spycalls saved in to the online dashboard?
  • Can recorded spycalls be played inside the online dashboard?
  • Can recorded calls be played on a computer?
  • Are recordings in the preferred AMR format?

RemCam capturing

  • Does the software allow for pictures to be taken when the phone is not in use?
  • Does the software use the back camera?
  • Does the software use the front picture?
  • Are captured pictures uploaded immediately?
  • Are the pictures displayed full-screen inside the online dashboard?
  • Can the user choose which camera to use for this?
  • Is the user notified if the camera is already in use?

 

Author: Marc Harris

Share This Post On