reading patterns in financial waves

“Extinction of old forms is the almost inevitable consequence of the production of new forms […]”

- Charles Darwin, The Origin of Species

There exists a deleterious belief about the financial world:

That financial markets are somehow too wild and random for machines to understand — they are simply too…

geographic formatting & spatial dataframes

and began exploring their mapmaking tools, including raster pixel tilings and searching for more pre-uploaded GIS items online.

However, there’s a fairly fundamental rule of data science:

The data you want usually isn’t in the place or shape you want it to…

all data has a location if you look hard enough

In the digital age we never lack for information, but often have trouble finding useful knowledge. The answer is nuance.

Context makes data truly useful.

Add the : Of all the total information about some topic, 80% of the “useful knowledge” is contained in about 20% of the net…

nature is cruel; statistics is worse

The online dating giant . Every now and then they put out something really fantastic, like that highlighted some fascinating discrepancies on the battlefield of love.

It turned some heads and generated some delightfully disruptive graphs, and has since…

black holes and temporal dimensions

As we move through the world, walking or flying in physical space, we also move through time. It’s well argued to be , for good reason: it takes time to do anything.

But then it gets a bit more tricky — we’re probably in something resembling

supraspatial decisionmaking

A core data science task is classification: grouping data points into various groups based on certain shared qualities.

In a sense, it’s an exercise as old as life itself: as soon as the first protozoan developed sensory organs, it (accidentally) started to act differently based on various sensory stimulus.

On…

relationships are complicated

The connections between data can often tell us more than the data itself.

Nothing in this world exists in a vacuum — everything is a part of something else, every piece of information is interlinked with other data. Ignore context at your own risk.

But since graphs are everywhere —…

unpacking Viviene Clay’s findings in reinforcement learning

I’ve written a few articles on Hierarchical Temporal Memory neural networks, which encode data into Sparse Distributed Representations to make noise-resistant predictions that consider multiple time-steps from the past input feed.

The key pioneer of HTM technologies, , holds weekly research meetings to discuss interesting new theories and advancements in…

tessellation, resolution and you

This is from . He uses some wicked cool tools to draw hexagonal filters over NASA photos of the United States, further breaks those hexagons down into tessellating diamonds, and makes the whole thing fairly interactive with Chipotle location density data.

Last week I spent an entire article…

bees figured this out ages ago

If you’re like me, you’ve always had a strange feeling that bees (much like dolphins) know more than they’re letting on.

They know architecture, and communicate navigational information through . Their elaborate caste-based hierarchy and collective survival impetus is striking. …

Mark Cleverley

data scientist, machine learning engineer. passionate about ecology, biotech and AI.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store