Skip to content

steven-cutting/SimpleTokenizer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A very simple package that implements a very simple method for generating ngrams and a bag of words representation from any given text.

The main purpose of this package is to provide a demonstration of three things:

  • Programing in a "more" Functional style in Python using the toolz library.
  • Using pytest for Test Driven Development.
  • Using Docker to run tests in a clean environment and against different versions of dependencies/python versions.

About

Simple package for generating ngrams and bag of words representation from text.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published