Analytics

Learning Phrases with PyLucene, part1

Lucene is a library that is used to build text search optimised indexes, it is an Apache project and is the core file format sitting under ElasticSearch. The following code uses pylucene which is a JNI wrapper to the Java API.

The algorithm derives from the idea that the terms in search results will have increased frequencies for their search terms and associated concepts. Phrases similarly should have increased frequencies. By using Lucene it is fast, though we have to index first. The code also demonstrates an integration between Lucene and Pandas for analytics. The technique here could be used summarise in aggregate user / player entered text in surveys, reviews etc. That might otherwise get ignored by analytics.

Continue reading

Analytical Problem Solving

Data can tell you much, but only if you know how to use it effectively. After all, if you know how many people have signed up to your service, but not how many are actually using it, you can’t truly understand customer behaviour and prioritise your service improvements. Analytical problem solving can help you gather the right data and use it to solve real problems - if you can build the insights that will reveal the full story of your customers, and help give you the answers you want from your data.

Continue reading

Training

If you have data analytics capability within your organisation, ask yourself, how often do you use it? Does the capability have the right skill sets for your business case? Are you relying on the data that your systems provide to make informed decisions about your business, or are you not sure whether you are joining the right data, what that data means and whether you can trust it?

Don’t worry, a lot of businesses are in the same boat. It’s one thing to have data available at your fingertips, and quite another to really understand and engage with it. But with the right knowledge, you could use the tools you already have to make a real difference to your business. That’s why training is such an essential part of building up your ability to make the most of your data. We offer a range of training courses and workshops designed to help everyone, from the business analyst who want to learn the latest data science techniques to executives who want to understand how their data can impact their business. We can help you understand the uses of data science inside your business, create an agile project map and an integration plan for impactful data science projects in your business.

Continue reading