Date: 16 - 20 June 2019
Venue: Frankfurt, Germany
Dr. Cesare Cugnasco from Barcelona Supercomputing Center (BSC) participated to the High-Performance conference (ISC 2019) that was held on 16 – 20 June in Frankfurt, Germany. The ISC High-Performance conference brings together over 3,500 researchers and commercial users, and 160 exhibitors, ready to share their experiences with the latest technology and products regarding HPC, ML, and Big Data. The BSC demonstration showed how the batch module of the I-BiDaaS platform can be used to run Machine Learning algorithms in a distributed environment. Furthermore, BSC showed the advanced 3D visualization capability of Qbeast, and it demonstrated the flexibility of the containerized infrastructure via a hands-on demonstration.
The demonstration drew many people from the research and the industrial environment. Most importantly, we had interesting discussions with CEOs of two Big Data related companies. The first CEO works in a European company that focuses on providing a simplified interface to manage and run HPC workloads. They were interested in the way we run our algorithms and in our Docker-based approach. However, they highlighted how we do not focus on HPC, while there is an increasing tendency of using HPC technologies to speed up large scale ML applications.
The second was the CEO of a Chinese startup that provides a platform to automatize the creation of ML models and to optimize the distributed execution of ML algorithms. They were interested in the possibility of visualizing the data and providing feedback to the model. Also, they focus on optimized scheduling; thus, they were interested in Dislib and COMPSs and Qbeast. However, they highlighted that customers are only partially interested in improving the algorithm runtime, while the primary focus is to make more effective data analysts, by using automatic workloads, ML model tuning, and algorithm selection.