trappy: skip empty array regex sub for common case

I found that trappy spends a lot of time looking for the array pattern "{}".
Vast majority of trace lines don't have them. Instead of running the regex
every time, check for the ={} pattern using the 'in' operator which is much
faster than the regex for the common case, and then do the regex sub if needed.

The speed up is huge and in my test run, I saw parsing stage on a 100MB trace
speed up from 13s -> 10.5s !!

Change-Id: I7ae68efc99eaf8844624871be2a4d66a7820a9b0
Signed-off-by: Joel Fernandes <joelaf@google.com>
Reviewed-by: KP Singh <kpsingh@google.com>
1 file changed
tree: e17f04ea79a74768e75144ef3361e9064a12b6e6
  1. doc/
  2. hooks/
  3. scripts/
  4. tests/
  5. trappy/
  6. .dir-locals.el
  7. .gitignore
  8. .travis.yml
  9. LICENSE
  10. README.md
  11. setup.cfg
  12. setup.py
README.md

TRAPpy Build Status Version

TRAPpy (Trace Analysis and Plotting in Python) is a visualization tool to help analyze data generated on a device. It parses ftrace-like logs and creates in-memory data structures to be used for plotting and data analysis.

Installation

The following instructions are for Ubuntu 14.04 LTS but they should also work with Debian jessie. Older versions of Ubuntu or Debian (e.g. Ubuntu 12.04 or Debian wheezy) will likely require to install more packages from pip as the ones present in Ubuntu 12.04 or Debian wheezy will probably be too old.

Required dependencies

Install additional tools required for some tests and functionalities
$ sudo apt install trace-cmd kernelshark
Install the Python package manager
$ sudo apt install python-pip python-dev
Install required python packages
$ sudo apt install libfreetype6-dev libpng12-dev python-nose
$ sudo pip install numpy matplotlib pandas ipython[all]
Install TRAPpy
$ sudo pip install --upgrade trappy

Quickstart

Now launch the ipython notebook server:

$ ipython notebook

This should pop up a browser. If it doesn't, open a web browser and go to http://localhost:8888/tree/

In the doc/ folder there's a 00 - Quick start which describes how to run TRAPpy. Other notebooks in that directory describe other functions of TRAPpy.

Documentation

API reference can be found in https://pythonhosted.org/TRAPpy/

For developers

Clone the repository

The code of the TRAPpy toolkit with all the supported tests and Notebooks can be cloned from the official GitHub repository with this command:

$ git clone https://github.com/ARM-software/trappy.git

Testing your installation

An easy way to test your installation is to use the nosetests command from TRAPpy's home directory:

$ nosetests

If the installation is correct all tests will succeed.