Skip to content

Commit 89028b7

Browse files
Add RU an EN Zevaykin PB (#8086)
Co-authored-by: Ivan Blinkov <ivan@ydb.tech>
1 parent b268811 commit 89028b7

File tree

13 files changed

+111
-4
lines changed

13 files changed

+111
-4
lines changed
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
## {{ ydb-short-name }}: dealing with Big Data and moving towards AI {#2024-qcon}
2+
3+
{% include notitle [general_tag](../../tags.md#general) %}
4+
5+
{{ ydb-short-name }} is a versatile, open-source Distributed SQL database management system that combines high availability and scalability with strong consistency and ACID transactions. It provides services for machine learning products and goes beyond traditional vector search capabilities.
6+
7+
{% include [no_video](../../no_video.md) %}
8+
9+
**Outline**:
10+
11+
This database is used for industrial operations within Yandex. Among its clients are Yandex Market, Yandex Alice, and Yandex Taxi, which are some of the largest and most demanding AI-based applications.
12+
13+
The database offers true elastic scalability, capable of scaling up or down by several orders of magnitude.
14+
15+
Simultaneously, the database is fault-tolerant. It is designed to operate across three availability zones, ensuring continuous operation even if one of the zones becomes unavailable. The database automatically recovers from disk failures, server failures, or data center failures, with minimal latency disruptions to applications.
16+
17+
Currently, work is underway to implement accurate and approximate nearest neighbor searches for machine learning purposes.
18+
19+
**Takeaways**:
20+
* Architecture of a distributed, fault-tolerant database.
21+
* Approaches to implementing vector search on large datasets.
22+
23+
[Slides](https://presentations.ydb.tech/2024/en/qcon/ydb_vector_search/presentation.pdf)

ydb/docs/en/core/public-materials/_includes/conferences/2024/coscup.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@
44

55
PostgreSQL is an implementation of SQL standard with one of the most vibrant ecosystems around it. To leverage all the tools and libraries that already know how to work with PostgreSQL, emerging database management systems that bring something new to the market need to learn how to mimic PostgreSQL. In this talk at [COSCUP 2024](https://coscup.org/2024/en/session/XZ98GN) [{{ team.blinkov.name }}]({{ team.blinkov.profile }}) ({{ team.blinkov.position }}) explores possible approaches to this and related trade-offs, as well as reasoning why YDB chose a unique approach to bring serializable consistency and seamless scalability to the PostgreSQL ecosystem.
66

7+
{% include [no_video](../../no_video.md) %}
8+
79
The presentation is suitable for people interested in trade-offs during implementation of PostgreSQL-compatible DBMS.
810

911
[Slides](https://presentations.ydb.tech/2024/en/coscup/presentation.pdf)

ydb/docs/en/core/public-materials/_includes/conferences/2024/kubecon-hongkong.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@
44

55
YDB is an open-source distributed database management system that, for performance reasons, uses raw disk drives (block devices) to store all data without any filesystem. It was relatively straightforward to manage such a setup in the bare-metal world of the past, but the dynamic nature of cloud-native environments introduced new challenges to keep this performance benefit. In this talk at [KubeCon + CloudNativeCon + Open Source Summit Hong Kong](https://kccncossaidevchn2024.sched.com/event/1eYZz), [{{ team.blinkov.name }}]({{ team.blinkov.profile }}) ({{ team.blinkov.position }}) explores how to leverage Kubernetes and the Operator design pattern to modernize how stateful distributed database clusters are managed without changing the primary approach to how the data is physically stored.
66

7+
@[YouTube](https://youtu.be/hXi7k2kGc38?si=K0yQ-CVJklXJe7Hq)
8+
79
YDB是一个开源的分布式数据库管理系统,为了性能考虑,使用原始磁盘驱动器(块设备)存储所有数据,而不使用任何文件系统。在过去的裸金属世界中管理这样的设置相对比较简单,但云原生环境的动态特性引入了新的挑战,以保持这种性能优势。在这次演讲中,我们将探讨如何利用Kubernetes和运算符设计模式来现代化管理有状态的分布式数据库集群,而不改变数据物理存储的主要方法。
810

911
[Slides](https://presentations.ydb.tech/2024/en/kubecon_hongkong/presentation.pdf)
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
## An approach to unite tables and persistent queues in one system {#2024-stackconf}
2+
3+
<div class = "multi-tags-container">
4+
5+
{% include notitle [general_tag](../../tags.md#general) %}
6+
7+
{% include notitle [database_internals](../../tags.md#database_internals) %}
8+
9+
</div>
10+
11+
People need databases to store their data and persistent queues to transfer their data from one system to another. We’ve united tables and persisted queues within one data platform. Now you have a possibility to take your data from a queue, then process it and keep the result in a database within a single transaction. So your application developers don’t need to think about data inconsistency in cases of connection failures or other errors.
12+
13+
@[YouTube](https://youtu.be/LOpP47pNFGM?si=vAXyubijAA31QaTR)
14+
15+
[{{ team.kalinina.name }}]({{ team.kalinina.profile }}) ({{ team.kalinina.position }}) tell you about an open-source platform called YDB which allows you to work with tables and queues within a single transaction. Elena walk you through architecture decisions, possible scenarios, and performance aspects of this approach.
16+
17+
[Slides](https://presentations.ydb.tech/2024/en/stackconf/tables-and-persistent/presentation.pdf)
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{% note info %}
2+
3+
The video will be available later.
4+
5+
{% endnote %}

ydb/docs/en/core/public-materials/videos.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,10 @@ Video recordings from conferences and webinars. The materials are divided by cat
1313

1414
{% include [COSCUP](./_includes/conferences/2024/coscup.md) %}
1515

16+
{% include [Qcon](./_includes/conferences/2024/Qcon.md) %}
17+
18+
{% include [stackconf](./_includes/conferences/2024/stackconf.md) %}
19+
1620
{% include [TechInternals](./_includes/conferences/2024/TechInternals.md) %}
1721

1822
{% include [Conf42](./_includes/conferences/2024/Conf42.md) %}

ydb/docs/en/presets.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,3 +24,8 @@ default:
2424
name: Alexander Smirnov
2525
position: Technology Expert at Nebius
2626
profile: https://www.linkedin.com/in/alexander-smirnov-bb990434/
27+
kalinina:
28+
name: Elena Kalinina
29+
position: Technical Project Manager
30+
profile: https://www.linkedin.com/in/elena-kalinina-2907b398/
31+

ydb/docs/ru/core/public-materials/_includes/conferences/2023/HighLoad_part_2.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88

99
</div>
1010

11-
5 лет назад Яндекс перешел с Kafka на собственную разработку поверх YDB. С тех пор Yandex Topic Service сильно подрос по нагрузке и вышел в Open Source. В этом докладе {{ team.zivaykin.name }} ({{ team.zivaykin.position }}) рассказывает про ускорение YDB Topic Service и приводит сравнение с конкурентами.
11+
5 лет назад Яндекс перешел с Kafka на собственную разработку поверх YDB. С тех пор Yandex Topic Service сильно подрос по нагрузке и вышел в Open Source. В этом докладе {{ team.zevaykin.name }} ({{ team.zevaykin.position }}) рассказывает про ускорение YDB Topic Service и приводит сравнение с конкурентами.
1212

1313
@[YouTube](https://www.youtube.com/watch?v=I-6SS6_C1Cw&list=PLH-XmS0lSi_yksBrXBOIgnuW_RmwfLKYn&index=22&pp=iAQB)
1414

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
### Гарантии доставки сообщений в {{ ydb-short-name }} Topics {#2024-it-picnic}
2+
3+
{% include notitle [database_internals_tag](../../tags.md#database_internals) %}
4+
5+
[{{ team.zevaykin.name }}]({{ team.zevaykin.profile }})({{ team.zevaykin.position }}) продемонстрировал базовые проблемы ненадежной передачи данных и способы борьбы с ними: повторы и дедупликацию. На примере паттернов микропроцессорной архитектуры он проиллюстрировал гарантии доставки: at-most-once, at-least-once, exactly-once.
6+
7+
@[YouTube](https://youtu.be/bdj_JrRPju0?si=392etOk5RyZVY6Kp)
8+
9+
В завершение выступления Александр показал детали реализации гарантий доставки на примере двух брокеров очередей сообщений: Kafka и {{ ydb-short-name }} Topics.
10+
11+
[Слайды](https://presentations.ydb.tech/2024/ru/it_picnic/ydb_topics/presentation.pdf)
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
### Гарантии доставки сообщений в {{ ydb-short-name }} Topics {#2024-saint-highload}
2+
3+
{% include notitle [database_internals_tag](../../tags.md#database_internals) %}
4+
5+
[{{ team.zevaykin.name }}]({{ team.zevaykin.profile }}) ({{ team.zevaykin.position }}) рассмотрел основные проблемы ненадёжной передачи данных и методы борьбы с ними: повторы и дедупликацию. Александр на примере паттернов микропроцессорной архитектуры продемонстрировал гарантии доставки: at-most-once, at-least-once, exactly-once.
6+
7+
Александр с докладом «Гарантии доставки сообщений в {{ ydb-short-name }} Topics» выступал на конференциях Saint HighLoad++ 2024 и ИТ-Пикник 2024:
8+
9+
{% list tabs %}
10+
11+
- Saint HighLoad++ 2024
12+
13+
@[YouTube](https://youtu.be/6l64n8t8Ivs?si=coC70xmfuaoIzxPA)
14+
15+
- ИТ-Пикник 2024
16+
17+
@[YouTube](https://youtu.be/bdj_JrRPju0?si=392etOk5RyZVY6Kp)
18+
19+
{% endlist %}
20+
21+
В заключение Александр на примере двух брокеров очередей сообщений — Kafka и {{ ydb-short-name }} Topics — показал детали реализации гарантий доставки.
22+
23+
[Слайды](https://presentations.ydb.tech/2024/ru/saint_highload/ydb_topics/presentation.pdf)

0 commit comments

Comments
 (0)