This project is a general exploration tool for time series. It implements Dynamic Time Warping (DTW) and pre-processing by clustering discussed in these papers.
http://real.mtak.hu/74287/1/p1595_neamtu_u.pdf http://real.mtak.hu/43722/1/p169_neamtu_u.pdf https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8509275
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.
The project uses Python interpreter version 3.6, but any latest Python version should work.
Make sure the following packages is installed in your environment:
cycler==0.10.0
fastdtw==0.3.2
kiwisolver==1.0.1
matplotlib==3.0.3
numpy==1.16.2
pandas==0.24.2
py4j==0.10.7
pyparsing==2.4.0
pyspark==2.4.1
python-dateutil==2.8.0
pytz==2018.9
scipy==1.2.1
six==1.12.0
sqlparse==0.3.0
psutil==5.6.2
You can install the package through pip install
pip install numpy
Navigate to the project's root directory. Run the following command:
python3 CLI_refactor.py
Now you are in the Genex Console, you should see the following prompt:
Java Home Path is set to None
GenexPlus >
Because PySpark runs Java, you need to set the Java Home for Genex. The Java version below 9.0 and above 1.7 is requried for the current implementation.
While in Genex Console, use the following command to set Java Home:
set <JAVA_HOME>
For example:
set /Library/Java/JavaVirtualMachines/jdk1.8.0_151.jdk/Contents/Home
If the above command runs successfully, you should see the following message in the console:
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Java home set at /Library/Java/JavaVirtualMachines/jdk1.8.0_151.jdk/Contents/Home
If you see warnings in the message, you could ignore them for they won't affect the program's functionality.
GenexPlus organizes user content under projects. To start, use the following command to open or create a GenexPlus Project:
open <project_name>
For example:
open example_project
If the project of given name is not found in Genex directory, you will be prompted if you wish to create a new project.
GenexPlus organizes user content under projects. To start, use the following command to open or create a GenexPlus Project:
open <project_name>
For example:
open example_project
If the project of given name is not found in Genex directory, you will be prompted if you wish to create a new project.