▽

湾区同学技术沙龙

(Bay Area) Bay Area Data Infrastructure Meetup (Zilliz&RisingWave&OceanBase)

17 June 2023

2:00PM ~ 6:00PM, 6/17/2023, Saturday

Details

👋 Hello, fellow engineers! We are thrilled to invite you to the Bay Area Data Infrastructure Meetup. Our primary objective is to unite all those who share a passion for infrastructure technologies and provide a forum to exchange knowledge, discuss best practices, and foster connections. Whether you are a developer, operations specialist, systems engineer, or anything in between, rest assured that you will gain valuable insights at the Bay Area Data Infrastructure Meetup. We look forward to seeing you there!

Registration

Join tech-meetup community:

Event Info

  • Time: 2:00PM ~ 6:00PM, 6/17/2023, Saturday
  • Location: 525 Almanor Ave STE 100, Sunnyvale, CA 94085
  • Language: Chinese (中文）

Agenda

  • 13:30 - 14:00 Check-in🎫
  • 14:00 - 14:50 Unleashing the Beast: Why We’re Obsessed with Distributed Database Performance🦁
  • 14:50 - 15:40 Streaming Data Engineering Essentials: Build Real-Time Data Platform with RisingWave🌊
  • 15:40 - 16:00 Coffee Break☕☕
  • 16:00 - 16:50 Supercharging LLM Apps: Strategies for Solving Data Problems Faced by LLM Apps🔋
  • 16:50 - 17:20 Navigating the Depths: High-Availability and High-Reliability in OceanBase🌊
  • 17:20 - 18:00 Networking and Socializing👋

Speakers

Zhifeng Yang, a Peking University computer science graduate, is a founding member and the Chief Architect of OceanBase. He’s dedicated his career to system software R&D and strives to position OceanBase as a leader in database technology. Having led the development of OceanBase’s SQL engine, resource balancing, and multi-modal database, he now oversees its architecture and innovative R&D. His interests and expertise span C++, distributed systems, SQL processing, transaction processing, and engineering efficiency.

Samuel is the Founding Member and General Manager of RisingWave Labs, which is building a cost-effective and scalable database solution designed to streamline data processing and querying. As an engineering leader, he has built RisingWave and RisingWave Cloud from scratch. Prior to RisingWave, he used to be the Senior Principal Engineer at Huawei and Senior Engineering Manager at Microsoft, working on databases, systems, and cloud technologies.

Yujian Tang is a Developer Advocate at Zilliz. He has a background as a software engineer working on AutoML at Amazon. Yujian studied Computer Science, Statistics, and Neuroscience with research papers published at conferences, including IEEE Big Data. He enjoys drinking bubble tea, spending time with family, and being near water.

Dr. Quanqing Xu, Technical Director at OceanBase Lab and a former National University of Singapore research fellow, holds a Computer Science Ph.D. from Peking University. His contributions, encompassing over 70 academic papers and patents, are significant in his field. Dr. Xu, a panel member at several international conferences, is also a Fellow of the IET and a senior member of the ACM and IEEE.

主办

(Bay Area) Snowflake / Databricks / OceanBase

3 September 2022

1:00PM ~ 6:00PM, 9/3/2022, Saturday

Registration

Join tech-meetup community:

Event Info

  • Time: 1:00PM ~ 6:00PM, 9/3/2022, Saturday
  • Location: Plug and Play HQ, 440 N Wolfe Rd, Sunnyvale, CA
  • Language: English

Agenda

  • 13:30 - 14:00 Check In
  • 14:00 - 14:50 A Decade of OceanBase: Performance, Architecture, and Evolution 🎙️Charlie Yang, OceanBase
  • 14:50 - 15:40 The Snowflake Data Cloud: a New Type of Cloud Dedicated to Data Analytics. 🎙️Jiaqi Yan, Snowflake
  • 15:40 - 16:00 Coffee Break & Speed Networking
  • 16:00 - 16:50 Databricks Photon: A Fast Query Engine for Lakehouse Systems 🎙️Gene Pang, Databricks
  • 16:50 - 17:20 Lightning talk: 61 Million QPS Challenge in Alipay: How Did We Do It 🎙️Ted Bai, OceanBase/Alipay

Details

👋 Hello, Engineer! Welcome to the first event of the Bay Area Data Infrastructure Meetup. Our goal is to share technical insights and best practices in this area and get engineers connected. Whether you are a developer, ops pro, system engineer, or any other IT professional excited about infrastructure technologies, the Bay Area Data Infrastructure Meetup will have something for you.

  • 📹 Webniar: https://us06web.zoom.us/j/87965510656?pwd=RUpLTXlxcURmODhzT2JqdUhLL1VyQT09

🍮🍺 Snacks and drinks will be provided.

👬We are going to hold a series of activities in the Bay Area, and looking forward to your warm participation. If you are interested in sharing your experiences – either as speakers or as users – kindly contact us: ailing.tal@alibaba-inc.com

Speakers

Jiaqi Yan is a Principal Software Engineer at Snowflake Computing. He primarily leads development efforts for the Compiler and Optimizer of the Snowflake Database, along with Workload Optimization, as well as Automation and Diagnostic Infrastructure in the Query Engine. Prior to joining Snowflake, Jiaqi worked as a Senior Member of Technical Staff for Oracle Database's Query Engine.

Gene Pang is a software engineer at Databricks, on the Photon Engine team. He is working on various Photon components such as window functions, sorting and aggregations. Before joining Databricks, Gene worked on distributed systems at Alluxio, and received his Ph.D. from UC Berkeley. His interests are in the areas of databases and distributed systems.

Charlie Yang is CTO at OceanBase. He joined Alibaba&Ant Group in 2010 as the first developer of OceanBase, led the architecture evolution and TPC benchmark test of OceanBase, he is leading the development and product team of OceanBase. Before joining Alibaba&Ant Group, he was Baidu's senior distributed system engineer. His research interest includes database, distributed system, and the cloud.

Ted Bai is the solution architect at OceanBase. He is working on designing and implementing scalable and resilient database solution for users in varies industries. Ted is also a former member of OceanBase SRE DBA team in Alipay. As a senior expert, he has been leading database migration and performance tuning projects in many mission-critical systems. In addition, Ted was also the owner of Alipay Digital Finance business on OceanBase.

主办

协办

  • 硅谷新创汇
  • 南京大学湾区校友会
  • 东南大学硅谷校友会
  • 中国科大硅谷校友会
  • 北加州清华校友会
  • 硅谷清华联网
  • 浙江大学校友会海纳创新创业俱乐部
  • 北京大学北加州校友会
  • 武汉大学北加州校友会
  • 吉林大学硅谷校友会会
  • 复旦大学北加州校友会
  • 华南理工大学美国校友会
  • 北加州华中科技大学校友会
  • 北京航空航天大学硅谷校友会
  • 北京邮电大学北美校友会
  • 上海交通大学硅谷校友会
  • 兰州大学北加州校友会
  • 电子科技大学硅谷校友会
  • 安徽大学北美校友会
  • 湖南大学北美校友会
  • 湘潭大学北美校友会
  • 哈工大硅谷校友会
  • 中山大学海外校友联网
  • 华人事业互助会
  • 长城会 RobotX Space

(Bay Area) 云端数据中台：数据编排与平台运维

15 September 2019

1:30PM ~ 4:00PM, 9/15/2019, Sunday

Registration

Join tech-meetup community:

Event Info

  • Time: 1:30PM ~ 4:00PM, 9/15/2019, Sunday
  • Location: 1st Floor Pitch Room, 4500 Great America Parkway, Santa Clara 95054 (ZGC Innovation Center)
  • Language: Chinese

Agenda

  • 1:30pm - 2:00pm: Reception and social time
  • 2:00pm - 3:30pm: Talk+ Q&A
  • 3:30pm - 4:30pm: Offline networking

Talk1: 如何把Alerts减少两个数量级: EA数据平台在云端运维的探索与演进

Abstract: Today, one can easily launch or terminate services with hundreds or thousands of compute instances in just a few seconds on cloud services such as AWS. However, operating, monitoring and maintaining those resources could also easily become a nightmare if the corresponding tooling systems were not designed in a cloud-native way.

Detail: In this talk, we share our lessons in building and rebuilding a cloud-native monitoring system to solve this problem at Electronic Arts (EA). In the first generation of the monitoring system, configurations were manually created for many individual software components and spread over all the resources. As services were started and terminated rapidly over time, it was extremely difficult to keep all the configurations up to date. Consequently, on average we received over 1,000 alerts from thousands of machines on a daily basis, which stressed the operations team. We redesigned the system in late 2018 in a project called Monitoring As Code (MAC) emphasizing on version control and automation. MAC manages all the configurations using a GIT project in the same way as software code. Moreover, it establishes standards so that the configurations are automatically generated and deployed to keep everything in sync. As a result, it reduced the daily average number of alerts by two orders of magnitude. A big data problem is reduced to a small data problem for human productivity and operational efficiency.

Speaker Bio: The speaker, Du Li, is currently an Architect of Big Data Infrastructure at Electronic Arts. He earned his BS from Wuhan University, MS from Peking University, and PhD from UCLA. He worked in academia and industrial labs for many years. Prior to joining EA in mid-2018, he worked at Yahoo and Apple as a senior software engineer.

Talk2: 基于Raft,gRPC,RocksDB和高并发算法打造存储10亿个文件的高效元数据服务

Abstract: 起源于UC Berkeley AMPLab的Alluxio是一个被百度、腾讯、华为、沃尔玛、Twosigma等行业巨头在云端广泛应用的开源数据编排系统。它的设计初衷之一包括能够高效存储并服务超大规模的文件系统中所有文件和目录的元数据。

Detail: 本演讲将分享Alluxio元数据服务（master节点）的架构，实现和优化，以解决可扩展性挑战。我们将特别介绍如何设计和应用合多个前沿工程技术和实践，包括基于堆外KV store RocksDB实现分层级的元数据存储，细粒度文件系统inode树锁方案，基于Raft分布式共识协议的master多节点高可用方案，以及社区对gRPC系统的探索和实践。结合上述技术，Alluxio 2.0的元数据服务能够存储至少10亿个文件，并在显着降低内存需求的同时扩展到3000个worker节点并为30000个客户端提供服务。

Speaker Bio: 范斌是Alluxio公司的创始成员与, Alluxio开源项目的PMC成员. 加入Alluxio团队前, 范斌在Google从事下一代大规模分布式存储系统的研究与开发. 范斌博士毕业于卡内基梅隆大学计算机系, 博士期间在分布式系统算法和系统实现等方向发表多篇包括SIGCOMM, SOSP, NSDI等顶级论文, 设计和实现了CuckooFilter，MemC3以及libCuckoo.

主办

协办

  • 硅谷新创汇
  • 南京大学湾区校友会
  • 东南大学硅谷校友会
  • 中国科大硅谷校友会
  • 北加州清华校友会
  • 硅谷清华联网
  • 浙江大学校友会海纳创新创业俱乐部
  • 北京大学北加州校友会
  • 武汉大学北加州校友会
  • 吉林大学硅谷校友会会
  • 复旦大学北加州校友会
  • 华南理工大学美国校友会
  • 北加州华中科技大学校友会
  • 北京航空航天大学硅谷校友会
  • 北京邮电大学北美校友会
  • 上海交通大学硅谷校友会
  • 兰州大学北加州校友会
  • 电子科技大学硅谷校友会
  • 安徽大学北美校友会
  • 湖南大学北美校友会
  • 湘潭大学北美校友会
  • 哈工大硅谷校友会
  • 中山大学海外校友联网
  • 华人事业互助会
  • 长城会 RobotX Space

(Bay Area) Google Doc 是如何炼成的 - 深入浅出协同编辑/Deep Dive Collaborative Editing

18 August 2019

1:30PM ~ 4:00PM, 8/18/2019, Sunday

Registration

Join tech-meetup community:

Event Info

  • Time: 1:30PM ~ 4:00PM, 8/18/2019, Sunday
  • Location: 1st Floor Pitch Room, 4500 Great America Parkway, Santa Clara 95054 (ZGC Innovation Center)
  • Language: Chinese

Agenda

  • 1:30pm - 2:00pm: Reception and social time
  • 2:00pm - 3:30pm: Talk+ Q&A
  • 3:30pm - 4:30pm: Offline networking

Talk Abstract：

随着互联网技术的发展，越来越多的企业协同软件都内嵌了实施协同编辑功能，从最早的鼻祖GoogleDocs, 到Quip, 再到最新流行的Notion 等等； 今天我们想就实时协同编辑技术进行深入浅出的探讨。

Speakers' bio

郑文涛：现任字节跳动旗下产品Lark(飞书)企业邮箱业务负责人，之前在Google GSuite 带领技术团队打造了两款从0到1的产品：Hangouts Chat 和 Jamboard.

主办

协办

  • 硅谷新创汇
  • 南京大学湾区校友会
  • 东南大学硅谷校友会
  • 中国科大硅谷校友会
  • 北加州清华校友会
  • 硅谷清华联网
  • 浙江大学校友会海纳创新创业俱乐部
  • 北京大学北加州校友会
  • 武汉大学北加州校友会
  • 吉林大学硅谷校友会会
  • 复旦大学北加州校友会
  • 华南理工大学美国校友会
  • 北加州华中科技大学校友会
  • 北京航空航天大学硅谷校友会
  • 北京邮电大学北美校友会
  • 上海交通大学硅谷校友会
  • 兰州大学北加州校友会
  • 电子科技大学硅谷校友会
  • 安徽大学北美校友会
  • 湖南大学北美校友会
  • 湘潭大学北美校友会
  • 哈工大硅谷校友会
  • 中山大学海外校友联网
  • 华人事业互助会
  • 长城会 RobotX Space

(Bay Area) An introduction of Analytics Zoo and how to use it at Uber

21 July 2019

1:30PM ~ 5:00PM, 7/21/2019, Sunday

Registration

Join tech-meetup community:

Event Info

  • Time: 1:30PM ~ 5:00PM, 7/21/2019, Sunday
  • Location: 1st Floor Pitch Room, 4500 Great America Parkway, Santa Clara 95054 (ZGC Innovation Center)
  • Language: Chinese

Agenda

  • 1:30pm - 2:00pm: Reception and social time
  • 2:00pm - 3:20pm: Deep Learning on Sensor Data with Analytics Zoo at Uber + Q&A
  • 3:20pm - 3:30pm: Break
  • 3:30pm - 4:50pm: Analytics Zoo Introduction + Q&A
  • 4:50pm - 5:10pm: offline networking

Talk 1: Deep Learning on Sensor Data with Analytics Zoo at Uber(Speaker: Lucinda Zhao)

Uber processes TBs of sensor data daily to build better products. For example crash detection with which operators can reach out to drivers who are detected going through accidents to provide prompt guidance and support. Sensor data is one important input to such applications.

Sensor data is ideal for Deep Learning. However, overhead for DL dev and productionisation is large -- most frameworks focus only on model training (forward/backward propagation) whereas data ingestion, model integration, pipeline management etc are left behind. Those steps may end up eating up big chunk of dev cycle. AnalyticsZoo fills in the missing pieces.

In this talk we will provide overall experience feedback for DL on large-scale business data with AnalyticsZoo from users’ point of view: how the workflow looks like, how AZ helps boost dev/productionisation efficiency in DL and what are the potential concerns. Overall it’s definitely a framework worth onboarding when live in the Hadoop-Spark BigData-DL ecosystem.

Lucinda(Luyu) Zhao: ML engineer at Sensor Intelligence team of Uber. Joined Uber in 2015 she has worked on various projects utilizing sensor data to provide inferences and insights. Before Uber she worked at Qualcomm designing baseband signal processing algorithm and architecture. She has background and production level first hand experience in big data, machine learning, wireless communication and signal processing.

Talk 2: An Introduction to Analytics Zoo: Distributed TensorFlow, Kerasand BigDLon Apache Spark (Yuhao Yang)

Analytics-Zoo是基于Apache Spark以及BigDL的开源分布式深度学习框架（https://github.com/intel-analytics/analytics-zoo）。它为Spark提供了深入学习功能的原生支持，同时为现成的使用单节点志强Xeon CPU的开源深度学习框架（如Caffe和Torch）带来了数量级的性能速度提升，并为它们提供了基于Spark架构的对深度学习任务的高效的水平扩展的能力；此外，它还允许数据科学家使用熟悉的工具（包括Python和Notebook等）来对大数据进行分布式深度学习分析。在这次演讲中，我们将演示大数据用户和数据科学家如何使用Analytics-Zoo以分布式方式对海量数据进行深度学习分析（如图像识别、对象检测、NLP等）。这可以让他们使用已有的大数据集群（例如Apache Hadoop和Spark）来作为数据存储、数据处理和挖掘、特征工程、传统的（非深度）机器学习和深度学习工作负载的统一数据分析平台。

Yuhao Yang: senior software engineer on the big data team at Intel, where he focuses on deep learning algorithms and applications—particularly distributed deep learning and machine learning solutions for fraud detection, recommendation, speech recognition, and visual perception. He’s also an active contributor to Apache Spark MLlib.

主办

协办

  • 硅谷新创汇
  • 南京大学湾区校友会
  • 东南大学硅谷校友会
  • 中国科大硅谷校友会
  • 北加州清华校友会
  • 硅谷清华联网
  • 浙江大学校友会海纳创新创业俱乐部
  • 北京大学北加州校友会
  • 武汉大学北加州校友会
  • 吉林大学硅谷校友会会
  • 复旦大学北加州校友会
  • 华南理工大学美国校友会
  • 北加州华中科技大学校友会
  • 北京航空航天大学硅谷校友会
  • 北京邮电大学北美校友会
  • 上海交通大学硅谷校友会
  • 兰州大学北加州校友会
  • 电子科技大学硅谷校友会
  • 安徽大学北美校友会
  • 湖南大学北美校友会
  • 湘潭大学北美校友会
  • 哈工大硅谷校友会
  • 中山大学海外校友联网
  • 华人事业互助会

See the index for more articles.