Dockercon 2019 SFO Recap & Announcements
This blog is just about key takeaway points from a Meetup Event : https://www.meetup.com/Docker-Bangalore/events/261474778/
and
https://github.com/collabnix/dockerbangalore/tree/master/slides/15th-June-2019-Dockercon19-Recap
=================================================
1. Dockercon 19 Recap & Announcement by
=================================================
2. Hardening and Securing your Kubernetes Platform – Munish Kumar Gupta
cAdvisor, is agent running at worker node, which collect usage information. It is not secure. As part of hardening, it is disabled.
One should refer : Docker file best practicies https://docs.docker.com/develop/develop-images/dockerfile_best-practices/
Important resources about security : Center for Internet Security (CIS)
https://en.wikipedia.org/wiki/Center_for_Internet_Security
https://www.cisecurity.org/
If master node comes down, then also the application will be keep running. Yes, during deployment if master node come down then deployment got impacted.
We should sepeate network for control plane (between master node, worker nodes) and user plane (for pod to pod communication among microservices)
We should have pod restart policy and health check API in plact at pod.
Munish kept camera icon on right top cornet to indicate picture time. Instead of taking notes, one can take picture of that important slide.
Generally at VISA deployment the VMs are run with 30 to 40 % of capacity. Containers run with higher capacity.
https://github.com/collabnix/dockerbangalore/blob/master/slides/15th-June-2019-Dockercon19-Recap/-
=================================================
3. Next Gen Payments Platform For Evolving Digital Economy – Sachin Karjatkar & Prabhu Kadapenthangal Venkatesan
=================================================
4. Sentiment Analysis using Stanford NLP , Docker , Helidon Microservice - Saiyam Pathak
DockerHub can pull DOCKERFILE from github and build Docker container image with appropriate config settings at DockerHub website.
Saiyam's suggested to use his github repository for K8s autoscaller components. https://github.com/saiyam1814/autoscaler
It is based on K8s git hub repository https://github.com/kubernetes/autoscaler
Helidon is a collection of Java libraries for writing microservices that run on a fast web core powered by Netty. https://helidon.io
Torando is a Python web framework and asynchronous networking library, https://www.tornadoweb.org
https://stanfordnlp.github.io/CoreNLP/
https://nlp.stanford.edu/sentiment/
https://github.com/stanfordnlp/CoreNLP
Nginx is a web server which can also be used as a reverse proxy, load balancer, mail proxy and HTTP cache.
Want to port forward a resource:
kubectl port-forward TYPE/NAME [LOCAL_PORT:]REMOTE_PORT
kubectl port-forward deployment/saiyam 8081:8080
=================================================
5. Running Docker containers on IoT - Sangam Biradar
Docker repository for Raspberry Pi https://hub.docker.com/u/arm32v7
https://www.slideshare.net/sangambiradar370/docker-on-iot-dockercon19-sfo-recap-announcements-bangalore
and
https://github.com/collabnix/dockerbangalore/tree/master/slides/15th-June-2019-Dockercon19-Recap
=================================================
1. Dockercon 19 Recap & Announcement by
Ajeet Singh Raina https://www.linkedin.com/in/ajeetsraina/
Blog : http://collabnix.com/
YouTube channel : https://www.youtube.com/channel/UCuXpQ3jNcNJBDKHBpWjb_fw
Importanat playlists
* Docker workshop https://www.youtube.com/watch?v=Q1jSDyZ4Org&list=PLImC3BtIMDrfsjF7eRYTnIufAccOtD1GI
Docker Labs : https://github.com/collabnix/dockerlabs DockerLabs brings you tutorials that help you get hands-on experience using Docker & Kubernetes.
Ajeet discussed about Docker desktop enterprise and its feature application designer. Version Packs is used for backward compatibility. https://blog.docker.com/2019/05/a-first-look-at-docker-desktop-enterprise/
He also talks about Docker Kubernetes Services, CLI plugin https://blog.docker.com/2019/05/kubernetes-lifecycle-management-with-docker-kubernetes-service-dks/
"docker buildx" is useful to build Docker container image for various on-premises and cloud platform in one shot. At present, available only in enterprise version.
One interesting webinar : "How Docker Simplifies Kubernetes for the Masses"
=================================================
2. Hardening and Securing your Kubernetes Platform – Munish Kumar Gupta
cAdvisor, is agent running at worker node, which collect usage information. It is not secure. As part of hardening, it is disabled.
One should refer : Docker file best practicies https://docs.docker.com/develop/develop-images/dockerfile_best-practices/
Important resources about security : Center for Internet Security (CIS)
https://en.wikipedia.org/wiki/Center_for_Internet_Security
https://www.cisecurity.org/
If master node comes down, then also the application will be keep running. Yes, during deployment if master node come down then deployment got impacted.
We should sepeate network for control plane (between master node, worker nodes) and user plane (for pod to pod communication among microservices)
We should have pod restart policy and health check API in plact at pod.
Munish kept camera icon on right top cornet to indicate picture time. Instead of taking notes, one can take picture of that important slide.
Generally at VISA deployment the VMs are run with 30 to 40 % of capacity. Containers run with higher capacity.
https://github.com/collabnix/dockerbangalore/blob/master/slides/15th-June-2019-Dockercon19-Recap/-
=================================================
3. Next Gen Payments Platform For Evolving Digital Economy – Sachin Karjatkar & Prabhu Kadapenthangal Venkatesan
=================================================
4. Sentiment Analysis using Stanford NLP , Docker , Helidon Microservice - Saiyam Pathak
DockerHub can pull DOCKERFILE from github and build Docker container image with appropriate config settings at DockerHub website.
Saiyam's suggested to use his github repository for K8s autoscaller components. https://github.com/saiyam1814/autoscaler
It is based on K8s git hub repository https://github.com/kubernetes/autoscaler
Helidon is a collection of Java libraries for writing microservices that run on a fast web core powered by Netty. https://helidon.io
Torando is a Python web framework and asynchronous networking library, https://www.tornadoweb.org
https://stanfordnlp.github.io/CoreNLP/
https://nlp.stanford.edu/sentiment/
https://github.com/stanfordnlp/CoreNLP
Nginx is a web server which can also be used as a reverse proxy, load balancer, mail proxy and HTTP cache.
Want to port forward a resource:
kubectl port-forward TYPE/NAME [LOCAL_PORT:]REMOTE_PORT
kubectl port-forward deployment/saiyam 8081:8080
=================================================
5. Running Docker containers on IoT - Sangam Biradar
Docker repository for Raspberry Pi https://hub.docker.com/u/arm32v7
https://www.slideshare.net/sangambiradar370/docker-on-iot-dockercon19-sfo-recap-announcements-bangalore
Consonants of Bhagavad Gita Text
Consonants
of Bhagavad Gita Text
Context
Sanskrit
language’s alphabet is very scientific. All the consonants are divided in
different classes. The different sounds made by birds is represented by class क
consonants (क, ख, ग, घ, ङ) , amphibians (e.g. frog)
sounds in class ट
(ट, ठ, ड, ढ, ण ),
mammals (e.g. sheep, goat, cows etc.) sounds
by class प
(प, फ, ब, भ, म ) and
all the divine prayers, mantras always contain at least one consonant from
unclassified category (य, र, ऱ, ल, ळ, ऴ, व, श, ष, स, ह,) . Thus,
the alphabet sequence of Sanskrit (and most of the Indian languages) indicates
evolution.
Here, an attempt is made to understand, the usage
of consonants in holy Hindu scripture Shrimad Bhagavad Gita, using Python code.
Method
·
Shrimad
Bhagavad Gita text file is loaded in Python code. This input file is UTF-8
format Unicode text.
· From
the input files, 37 consonants are identified. Their Unicode is 0xE0A495 for क, to 0xE0A4BA for ह.
·
The dictionary data structure is used, to associate
all the consonants with different consonant classes and with different
speakers. For source code, please refer https://github.com/mpanchmatia/BhagavadGitaAlphabet
Some important findings
·
Shrimad
Bhagavad Gita contains total 30271 consonants. The Devanagari (Hindi) script
has total 37 unique Unicodes for consonants.
· Out
of these 30271 constantans, majority of consonants 40.22 % used in Shrimad Bhagavad Gita are
belongs to unclassified category. The least contribution 2.15 % is from class ट. Here is the detail breakup.
Consonant class
|
Consonants
|
Count
|
Percentage
|
Class
क
|
क, ख, ग, घ, ङ
|
2116
|
6.99
%
|
Class
च
|
च, छ, ज, झ, ञ
|
1746
|
5.77
%
|
Class
ट
|
ट, ठ, ड, ढ, ण
|
650
|
2.15
%
|
Class
त
|
त, थ, द, ध, न, ऩ
|
8611
|
28.45
%
|
Class
प
|
प, फ, ब, भ, म
|
4973
|
16.43
%
|
Unclassified
|
य, र, ऱ, ल, ळ, ऴ, व, श, ष, स, ह,
|
12175
|
40.22
%
|
Total
|
30271
|
30271
|
100
%
|
· The least one is झ pronounced only for once by the lord Krishna.
· The most frequent consonants uttered is त, 3931 times and
· Out of these 30271 constantans, majority of consonants 80.37% of consonants are uttered by the lord Krishna and 13.39 % of constantans are uttered by Arjuna. Here is the detail breakup.
· The most frequent consonants uttered is त, 3931 times and
· Out of these 30271 constantans, majority of consonants 80.37% of consonants are uttered by the lord Krishna and 13.39 % of constantans are uttered by Arjuna. Here is the detail breakup.
Speaker
|
Number of consonants
|
Percentage of
consonants
|
Arjuna
|
4052
|
13.39
%
|
the
lord Krishna
|
24330
|
80.37
%
|
Sanjay
|
1730
|
5.72
%
|
Dhritarashtra
|
42
|
0.14
%
|
None
|
117
|
0.39
%
|
Total
|
30271
|
100
%
|
Please refer https://github.com/mpanchmatia/BhagavadGitaAlphabet/blob/master/output.txt for deatil break-up of all consonants uttered by all characters.
Future
Scope
·
The scope of consonants analysis can be further
extended, like, identify patterns that can be corelated to energy movement in
the body and impact on brain from neuroscience perspective.
·
The analysis can be done to other ancient Sanskrit
text, epic, hymns etc.
·
One can target famous text from other languages
also and perform comparative analysis.
Container Orchestration
What is Container Orchestration ?
- Fault tolerant
- Scaling
- Optimally use resources
- Discovery
- Access from outside world
- Update/rollback with 0 downtime
What Container Orchestrators do?
- cluster = multiple host together
- schedule container(pod) to run on host/node
- network among pod on different nodes
- bind container with storage
- services = group of containers
- keep resource usage in check and optimize if needed
- secure access to app running inside continer
Deployment options
on-premise v/s cloud
bare-matel v/s VM
Container Orchestrators
- Kubernetes
- Docker Swarm
- Mesos Marathon
- Docker Compose : Single machine. Not for large scale. With one command, "docker compose up" it will bring up : containers, volumes, networks
- Hashicorp Nomad
- Amazon ECS (Amazon EC2 container service)
1. Task == Pod
2. It has its own repository.
3. Task can be part of CloudFormation stack. Task, Queue, EC2 Volume all together in
4. CloudFormation to start and to cleanup
5. To get started https://aws.amazon.com/ecs/
- AWS Fargate https://aws.amazon.com/fargate
- Google Kubernetes Engine (^L = clear = cls at Google Cloud Shell)
- Microsoft Azure Kubernetes Services (AKS)
- Cloud Foundry
- Rackspace
- Oracle Cloud Infrastructure
- Rancher
K8s Features
- schedule pod based on resource usage and constrain with HA
- self-healing
- scaling
- service discovery + load balancing.
- auto rollout and rollback
- secrets and config mgt
- storage orchstration with SDS
- batch execution
- RBAC
- Fault tolerant
- Scaling
- Optimally use resources
- Discovery
- Access from outside world
- Update/rollback with 0 downtime
What Container Orchestrators do?
- cluster = multiple host together
- schedule container(pod) to run on host/node
- network among pod on different nodes
- bind container with storage
- services = group of containers
- keep resource usage in check and optimize if needed
- secure access to app running inside continer
Deployment options
on-premise v/s cloud
bare-matel v/s VM
Container Orchestrators
- Kubernetes
- Docker Swarm
- Mesos Marathon
- Docker Compose : Single machine. Not for large scale. With one command, "docker compose up" it will bring up : containers, volumes, networks
- Hashicorp Nomad
- Amazon ECS (Amazon EC2 container service)
1. Task == Pod
2. It has its own repository.
3. Task can be part of CloudFormation stack. Task, Queue, EC2 Volume all together in
4. CloudFormation to start and to cleanup
5. To get started https://aws.amazon.com/ecs/
- AWS Fargate https://aws.amazon.com/fargate
- Google Kubernetes Engine (^L = clear = cls at Google Cloud Shell)
- Microsoft Azure Kubernetes Services (AKS)
- Cloud Foundry
- Rackspace
- Oracle Cloud Infrastructure
- Rancher
K8s Features
- schedule pod based on resource usage and constrain with HA
- self-healing
- scaling
- service discovery + load balancing.
- auto rollout and rollback
- secrets and config mgt
- storage orchstration with SDS
- batch execution
- RBAC
Developers With Possibilities - CallForCode2019
Can technology can really solve the issues
concerning to Natural Disasters or Health? Can it really become a powerful
medium to answer some of biggest problem of the mother earth? Definitely Yes,
It can certainly solve or prove a powerful medium to reach the last person
affected due to Natural Calamities. In simple terms, Technology can help to
reduce the impact of Natural Disasters.
A study conducted by World Bank in year
2008 about Philippines stated that, “50% of its total land and more than 80% of
its total population is venerable to Natural Disasters”. In fact, Philippines
is the 3rd most venerable country in the world as far as Natural
Disasters and its aftermath is considered.
Heavy and sudden floods; intense monsoons
play a vital role to destroy the land and its population the most. Can
something be done about it? As a
developer myself, I can say Yes.
With proper use of technology, Analytical
Data can be easily used to provide essential information as to how a particular
structure will respond in case of any unfortunate situation. Cities or
Countries which are more affected by such Disaster can easily integrate and
make use of geospatial data and come up proper maintenance plan of Entire
Township. Geospatial Data provide precise geographical component of a
particular areas and thus can play pivotal role in Township Planning and
Maintain acne.
Let us take another example and understand
How Innovation and Technology Together Can Help us in staying ahead in case of
Natural Disaster. In last one decade or so total loss due to natural disaster
is around $200 Billion which was at year on year average of 50
billion USD. Trends suggest that rising population and urbanization are driving
losses in vulnerable regions. More than million people are moving towards
cities every week, most of which is happening in region of Africa and Asia. On
the other hand, climate change threatens push 100 million more people into
poverty by 2030. Such information is enough to make it clear that disaster risk
isn’t static, but rapidly evolving.
Global Facility for Disaster Reduction and
Recovery (GFDRR) – A World Bank Initiative along with 34 countries and 9
international organizations across globe are motivating governments of various
countries to come forward and invest in smarter technologies such as AI, Mobile
Applications, and Navigations etc. and make citizen aware of risk much before it
is going to happen. Today, Mobile Phone has a wider reach and even a small SMS in regional language can save millions of life even before a disaster take
place.
Do you know that an air balloon can deliver
internet in the most rural and unconnected places in the world, Kites can be
used to generate electricity in unexpected region. Surprised!
These are some of the issues which are actually
solved with the effective use of Technology. So why can’t we come ahead in great numbers and pledge to build
solutions to protect the interest of last man living on earth and protect
his/her from the aftermath of Natural Disaster!
More than a 1,00,000 developers from 156
countries participated in year 2018 call For Code Challenge organized by IBM
and David Clark Cause. More than 2500 applications were designed, developed
with use of IBM products and technologies by sharing of knowledge, resource and
proper mentorship. Each of the solutions focused on some real life challenges.
The aim was simple, Give back To the Society, To Your People something that can
save their life and help them to stay healthy.
The mission remains the same this time too.
Come forward and join #Callforcode2019 challenge and build solutions that can
solve or reduce the impact of Natural Disaster on Human Life.
The Process to Participate is simple:-
- Register Yourself with IBM ID on the website https://developer.ibm.com/callforcode
- Make use of Available Resources and Technologies and Build Your Solutions
- Be the part of Developer’s Community and share your idea , take necessary mentorship , build team and complete the project.
- Submit your code with proper demo with participant agreement.
Don’t miss the opportunity this time. Last
date is July 29, 2019.
Be the Best. The Winner will get a loud
shout on Award Night with a cash reward of $ 2,00,000 apart from Investors
and Technology Support.
It’s time to rock!! Go ahead and mark your
presence with a solution that matters the most.
