This site uses cookies. Browsing the site, you agree to the use of cookies. If you need more information, please visit the Cookies Policy page
Cryptocurrencies: 3840 / Markets: 33455
Market Cap: $ 560 838 968 320 / 24h Vol: $ 222 808 974 212 / BTC Dominance: 62.146864251245%

Н News

Five Machine Learning Methods Crypto Traders Should Know About

In a recent article, I discussed the relevance of the machine learning techniques powering the famous OpenAI’s GPT-3 could have for the crypto market. GPT-3 – which can answer questions, perform language analysis and generate text – might be the most famous achievements in recent years of the deep learning space. But, by no means, is it the most applicable to the crypto space. In this article, I would like to discuss some novel areas of deep learning that can have a near immediate impact in the quant models applied to crypto.

Models such as GPT-3 or Google’s BERT are the result of a massive breakthrough in deep learning known as language pretrained and transformer models. These techniques, arguably, represent the biggest milestone in the last few years of the deep learning industry and their impact hasn’t gone unnoticed in capital markets.

In the last year, there have been active research efforts in quantitative finance exploring how transformer models can be applied to different asset classes. However, the results of these efforts remain sketchy showing that transformers are far from ready to operate in financial datasets and they remain mostly applicable to textual data. But there is no reason to feel bad. While adapting transformers to financial scenarios remains relatively challenging, other new areas of the deep learning space are showing promise when applied in quant models on various asset classes including crypto.

From many angles, crypto seems to be like the perfect asset class for deep learning-based quant models. That’s because of the the digital DNA and the transparency of crypto assets and that the rise of crypto has coincided with a renaissance of machine learning and the emergence of deep learning.

After decades of struggle and a couple of so-called “artificial intelligence(AI) winters,” deep learning has finally become real and somewhat mainstream across different areas of the software industry. Quantitative finance has been one of the fastest adopters of new deep learning technologies and research. It is very common for some of the top quant funds in the market to experiment with the same types of ideas coming out of high tech AI research labs such as Facebook, Google or Microsoft.

See also: Jesus Rodriguez – 10 Reasons Quant Strategies for Crypto Fail

Some of the most exciting developments in modern quant financing are not coming from flashy techniques like transformers, but from exciting machine learning breakthroughs that are more developed for quant scenarios. Many of those methods are perfectly applicable to crypto-asset quant techniques and are starting to make inroads in crypto quant models.

Below, I’ve listed five emerging areas of deep learning that are particularly important to crypto quant scenarios. I tried to keep the explanations relatively simple and tailored to crypto scenarios.

Blockchain datasets are a unique source of alpha for quant models in the crypto space. From a structural perspective, blockchain data is intrinsically hierarchical and is represented by a graph with nodes representing addresses connected by edges representing transactions. Imagine a scenario in which a quant model is trying to predict volatility in Bitcoin in a given exchange based on the characteristics of addresses transferring funds into the exchange. That kind of model needs to operate efficiently over hierarchical data. But most machine learning techniques are designed to work with tabular datasets, not graphs.

Graph neural networks (GNNs) are a new deep learning discipline that focuses on models that operate efficiently on graph data structures. GNNs are a relatively new area of deep learning being invented only in 2005. However, GNNs have seen a lot of adoptions from companies like Uber, Google, Microsoft, DeepMind and others.

In our sample scenario, a GNN could use a graph as input representing the flows in and out of exchanges and infer relevant knowledge relevant to its impact on price. In the context of crypto assets, GNNs have the potential of enabling new quant methods based on blockchain datasets.

One of the limitations of machine learning quant models is the lack of large historical datasets. Suppose that you are trying to build a predictive model for the price of ChainLink(LINK) based on its historical trading behavior. While the concept seems appealing it might prove to be challenging as LINK has a little over a year of historical trading data in exchanges like Coinbase. That small dataset will be insufficient for most deep neural networks to generalize any relevant knowledge.

Generative models are a type of deep learning method specialized in generating synthetic data that matches the distribution of a training dataset. In our scenario, imagine that we train a generative model in the distribution of the link orderbook in Coinbase in order to generate new orders that match the distribution of the real orderbook.

Combining the real dataset and the synthetic one, we can build a large enough dataset to train a sophisticated deep learning model. The concept of generative model is not particularly new but has gotten a lot of traction in recent year with the emergence of popular techniques such as generative adversarial neural networks(GANs) which have become one of the most popular methods in areas such as image classification and have been used with relevant success with time series financial datasets.

Labeled datasets are scarce in the crypto space and that severely limits the type of machine learning quant models that can be built in real world scenarios. Imagine that we are trying to build an ML model that makes price predictions based on activity of OTC desks. To train that model, we would need a large labeled dataset with addresses belonging to OTC desks which is the type of dataset that only a few entities in the crypto market possesses.

Semi-supervised learning is a deep learning technique that focuses on the creation of models that can learn with small labeled datasets and a large volume of unlabeled data. Semi-supervised learning is analogous to a teacher presenting a few concepts to a group of students and leaves the other concepts to homework and self-study.

In our sample scenario, imagine that we train a model with a small set of labeled trades from OTC desks and a large set of unlabeled ones. Our semi-supervised learning model will learn key features from the labeled dataset such as trade size or frequency and will use the unlabeled dataset to expand the training.

Feature extraction and selection are a key component of any quant machine learning model and is particularly relevant in problems that are not very well understood such as crypto asset predictions. Imagine that we are trying to build a predictive model for the price of Bitcoin based on order book records.

One of the most important aspects of our effort is to determine which attributes or features can act as predictors. Is it the mid-price, the volume or a hundred other factors? The traditional approach is to rely on subject matter experts to handcraft these features but that can become hard to scale and maintain over time.

Representation learning is an area of dep learning focused on automating the learning of solid representations or features in order to build more effective models. Instead of relying on human feature modeling, representation learning tries to extrapolate features directly from unlabeled datasets. In our example, a representation learning method could analyze the order book and identify hundreds of thousands of potential features that can act as predictors for the Bitcoin prices. That level of scaling and automation is impossible to achieve in manual feature engineering.

The process of creating quant machine learning models remains highly subjective in many aspects. Let’s take the scenario of a model that is trying to forecast the price of Ethereum based on activity in a set of DeFi protocols. Given the nature of the problem, data scientists will have certain preferences about the type of model and architecture to use.

In our scenario, most of those ideas would be based on domain knowledge and subjective opinions about the way the activity in DeFi protocols can impact the price of Ethereum. Given that machine learning is based on building knowledge and knowledge is not a discrete unit, its almost impossible to debate the merits of one method versus another for a given problem.

Neural architecture search(NAS) is one area of deep learning that tries to automate the creation models using machine learning. Sort of using machine learning to create machine learning. Given a target problem and dataset, NAS methods will evaluate hundreds of possible neural network architectures and output the ones with the most promising results.

In our sample scenario, a NAS method can process a dataset that incorporates trades in decentralized exchanges and produce a few models that can potentially predict the price of Ethereum based on those records.

The methods described above represent some emerging and more developed areas of deep learning that are likely to have an impact in the crypto quant models in the short term. And, those are by no stretch the only areas of deep learning crypto quant should pay attention to.

Other deep learning disciplines such as reinforcement learning, self-supervised learning and even transformers are rapidly making inroads in the quant space. Research and experimentation about deep learning techniques applied to quant models is happening everywhere and crypto stands to be a great beneficiary of that wave of innovation.

Source

  • 14.09.20 17:21 Попков С.А.

    ​здарова бандиты

  • 14.09.20 17:30 Серега Бумер

    Привет из Москвы

  • 14.09.20 17:35 Анастасия

    Давайте биткоин по 20к

  • 14.09.20 17:40 Лысый Боб

    Подарите книгу)))

  • 14.09.20 17:41 Светлана П

    Hello

  • 14.09.20 17:48 Николаев

    Понеслась

  • 14.09.20 17:53 Щука А

    Слава эфиру

  • 14.09.20 17:58 Захар Трофимов

    Надо изучать Defi , интересно

  • 14.09.20 17:59 Павел Павлов

    15$. профита всем

  • 14.09.20 18:01 Попко Колян

    Давайте биткоин по 20к

  • 14.09.20 18:08 Попков С.А.

    Круто

  • 14.09.20 18:13 Алексей С.

    ​гуд

  • 14.09.20 18:18 Попков С.А.

    Как успехи?

  • 14.09.20 18:24 Попко Колян

    👍👍👍👍👍

  • 14.09.20 18:26 Егор Шетюк

    Понеслась

  • 14.09.20 18:26 Захар Трофимов

    15$. Тюмень рулит😁

  • 14.09.20 18:35 Константин В.В

    Биток и эфир держу до лучших времён)

  • 14.09.20 18:38 Попко Колян

    ​ДОБРОГО

  • 14.09.20 18:43 Даниил

    Рига смотрит

  • 14.09.20 18:46 Вадим Никулин

    Всегда смотрю Вас!

  • 14.09.20 18:55 Захар Трофимов

    Минск на проводе

  • 14.09.20 18:56 Щука А

    Спасибо за ваш труд

  • 14.09.20 19:01 Никита

    Хай

  • 14.09.20 19:06 Вячеслав Левков

    Отложил биток на пенсию

  • 14.09.20 19:13 Попков С.А.

    Отличные эфиры у вас

  • 14.09.20 19:20 Щука А

    Привет из Москвы

  • 14.09.20 19:25 Алексей С.

    Всем РЕСПЕКТ

  • 14.09.20 19:27 Николай

    Вперед криптаны

  • 14.09.20 19:34 КРИПТАН

    Слышно гуд

  • 14.09.20 19:36 Егор Шетюк

    Подарите книгу)))

  • 14.09.20 19:44 Светлана П

    миллионерам привет

  • 14.09.20 19:48 Вячеслав Левков

    Крипта скам=)

  • 14.09.20 19:53 Тоха

    Понеслась

  • 14.09.20 19:57 Носов А.А

    Рига смотрит

  • 14.09.20 20:04 Прокоп

    Донаты принемаете?

  • 14.09.20 20:06 Носов А.А

    спасибо

  • 14.09.20 20:12 Юрий Ник

    Тюмень рулит😁

  • 14.09.20 20:18 Даниил

    миллионерам привет

  • 14.09.20 20:18 Нина

    17$. Биток и эфир держу до лучших времён)

  • 14.09.20 20:24 Никита

    18$. Задонатю вам баблишка)

  • 14.09.20 20:25 Вячеслав Левков

    Поможем парням лайками, я уже свой поставил

  • 14.09.20 20:26 Павел Скоровойтов

    Слава эфиру

  • 14.09.20 20:35 Носов А.А

    Привет, пацаны. Слышно, видно хорошо

  • 14.09.20 20:36 Тоха

    Шалом

  • 14.09.20 20:44 Лена

    Биток и эфир держу до лучших времён)

  • 14.09.20 20:47 Нина

    ​ку-ку)

  • 14.09.20 20:53 Попков С.А.

    Все good. Ростем потихоньку и падаем, как всегда

  • 14.09.20 20:58 Санек

    Всем РЕСПЕКТ

  • 14.09.20 21:01 Славка Орехов

    Спасибо за ваш труд

  • 14.09.20 21:10 Ваня А,

    Привет, пацаны. Слышно, видно хорошо

  • 14.09.20 21:13 Нина

    ​ДОБРОГО

  • 14.09.20 21:20 Никита

    Привет парни!

  • 14.09.20 21:25 Егор Шетюк

    Hello

  • 14.09.20 21:27 Вячеслав Левков

    ​ку-ку)

  • 14.09.20 21:33 Попков С.А.

    Тамбов с вами братва

  • 14.09.20 21:37 Серега Бумер

    Слава эфиру

  • 14.09.20 21:42 Ваня А,

    Подарите книгу)))

  • 14.09.20 21:50 Павел Скоровойтов

    Поможем парням лайками, я уже свой поставил

  • 14.09.20 21:54 Захар Трофимов

    Привет парни!

  • 14.09.20 21:56 Санек

    Отложил биток на пенсию

  • 14.09.20 22:03 Носов А.А

    Привет, пацаны. Слышно, видно хорошо

  • 14.09.20 22:03 Попков С.А.

    14$. Надо изучать Defi , интересно

  • 14.09.20 22:09 Николай

    Поможем парням лайками, я уже свой поставил

  • 14.09.20 22:14 Вадим Никулин

    Я из РБ слежу за вами давно💰

  • 14.09.20 22:17 Николай

    Поможем парням лайками, я уже свой поставил

  • 14.09.20 22:24 Лена

    ​Я снова с вами)))

  • 14.09.20 22:28 Носов А.А

    Отложил биток на пенсию

  • 14.09.20 22:31 Серега Бумер

    Тюмень рулит😁

  • 14.09.20 22:40 Светлана П

    Сморгонь 👍

  • 14.09.20 22:43 Вадим Никулин

    Отложил биток на пенсию

  • 14.09.20 22:46 Николаев

    Круто

  • 14.09.20 22:53 Ваня А,

    Люблю ваши трансляции, вы крутые!

  • 14.09.20 22:58 Вячеслав Левков

    Биток вперед!!!

  • 14.09.20 23:05 Носов А.А

    ​Привет всем с Украины!

  • 14.09.20 23:06 Носов А.А

    12$. ​здарова бандиты

  • 14.09.20 23:09 Константин В.В

    Отложил биток на пенсию

  • 14.09.20 23:14 Прокоп

    Екатеринбург на связи

  • 14.09.20 23:18 Николаев

    Круто

  • 14.09.20 23:25 Тоха

    ​здарова бандиты

  • 14.09.20 23:27 Попков С.А.

    Отличные эфиры у вас

  • 14.09.20 23:33 Лена

    Поможем парням лайками, я уже свой поставил

  • 14.09.20 23:39 Николаев

    Доброе утречко

  • 14.09.20 23:45 Лена

    Как успехи?

  • 14.09.20 23:49 Павел Скоровойтов

    ​ку-ку)

  • 14.09.20 23:51 Ваня А,

    Привет, пацаны. Слышно, видно хорошо

  • 14.09.20 23:57 Попков С.А.

    Хомяки тут

  • 15.09.20 00:01 Лысый Боб

    Привет, пацаны. Слышно, видно хорошо

  • 15.09.20 00:07 Санек

    Слава эфиру

  • 15.09.20 00:12 Щука А

    Екатеринбург на связи

  • 15.09.20 00:14 Нина

    23$. Лайк

  • 15.09.20 00:16 Юрий Ник

    Вперед криптаны

  • 15.09.20 00:25 Лена

    Биток и эфир держу до лучших времён)

  • 15.09.20 00:26 Попков С.А.

    Как успехи?

  • 15.09.20 00:33 Попко Колян

    Я из РБ слежу за вами давно💰

  • 15.09.20 00:40 Даниил

    миллионерам привет

  • 15.09.20 00:50 Константин В.В

    11$. Круто

  • 17.09.20 15:31 Trident

    купил билет на семинар который изначально планировался в субботу.... в пятницу не смогу послушать, гле посмотреть запись?

  • 24.09.20 12:08 Серго1985

    Как бабло зарабатывается??

  • 15.10.20 09:16 Vyacheslav

    отлично зарабатывается !)

  • 15.10.20 09:16 Vyacheslav

    у вас как?

To join the Chat, you need a free pro-blockchain.com account. Enter Registration