第 8 章 容器网络

flannel 概述

 

flannel 是 CoreOS 开发的容器网络解决方案。

flannel 为每个 host 分配一个 subnet，容器从此 subnet 中分配 IP，这些 IP 可以在 host 间路由，容器间无需 NAT 和 port mapping 就可以跨主机通信。

 

每个 subnet 都是从一个更大的 IP 池中划分的，flannel 会在每个主机上运行一个叫 flanneld 的 agent，其职责就是从池子中分配 subnet。

为了在各个主机间共享信息，flannel 用 etcd（与 consul 类似的 key-value 分布式数据库）存放网络配置、已分配的 subnet、host 的 IP 等信息。

 

数据包如何在主机间转发是由 backend 实现的。

flannel 提供了多种 backend，最常用的有 vxlan 和 host-gw。（其他 backend 请参考 https://github.com/coreos/flannel。）

 

flannel实验环境描述如图：

etcd 部署在 10.12.31.21上，host1（10.12.31.22） 和 host2（10.12.31.23） 上运行 flanneld，首先安装配置 etcd。

 

1）安装配置 etcd

[root@ubuntu ~]$cat etcd_install.sh
ETCD_VER=v2.3.7
DOWNLOAD_URL=https://github.com/coreos/etcd/releases/download
curl -L ${DOWNLOAD_URL}/${ETCD_VER}/etcd-${ETCD_VER}-linux-amd64.tar.gz -o /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz
mkdir -p /tmp/test-etcd && tar xzvf /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz -C /tmp/test-etcd --strip-components=1
cp /tmp/test-etcd/etcd* /usr/local/bin/

[root@ubuntu ~]$sh etcd_install.sh 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   153    0   153    0     0    141      0 --:--:--  0:00:01 --:--:--   141
100   620    0   620    0     0    405      0 --:--:--  0:00:01 --:--:--  100k
100 8347k  100 8347k    0     0   222k      0  0:00:37  0:00:37 --:--:--  250k
etcd-v2.3.7-linux-amd64/Documentation/
etcd-v2.3.7-linux-amd64/Documentation/runtime-configuration.md
etcd-v2.3.7-linux-amd64/Documentation/admin_guide.md
etcd-v2.3.7-linux-amd64/Documentation/tuning.md
etcd-v2.3.7-linux-amd64/Documentation/glossary.md
etcd-v2.3.7-linux-amd64/Documentation/rfc/
etcd-v2.3.7-linux-amd64/Documentation/rfc/v3api.md
etcd-v2.3.7-linux-amd64/Documentation/discovery_protocol.md
etcd-v2.3.7-linux-amd64/Documentation/errorcode.md
etcd-v2.3.7-linux-amd64/Documentation/metrics.md
etcd-v2.3.7-linux-amd64/Documentation/security.md
etcd-v2.3.7-linux-amd64/Documentation/configuration.md
etcd-v2.3.7-linux-amd64/Documentation/docker_guide.md
etcd-v2.3.7-linux-amd64/Documentation/dev/
etcd-v2.3.7-linux-amd64/Documentation/dev/release.md
etcd-v2.3.7-linux-amd64/Documentation/members_api.md
etcd-v2.3.7-linux-amd64/Documentation/auth_api.md
etcd-v2.3.7-linux-amd64/Documentation/backward_compatibility.md
etcd-v2.3.7-linux-amd64/Documentation/platforms/
etcd-v2.3.7-linux-amd64/Documentation/platforms/freebsd.md
etcd-v2.3.7-linux-amd64/Documentation/libraries-and-tools.md
etcd-v2.3.7-linux-amd64/Documentation/implementation-faq.md
etcd-v2.3.7-linux-amd64/Documentation/reporting_bugs.md
etcd-v2.3.7-linux-amd64/Documentation/upgrade_2_2.md
etcd-v2.3.7-linux-amd64/Documentation/internal-protocol-versioning.md
etcd-v2.3.7-linux-amd64/Documentation/upgrade_2_1.md
etcd-v2.3.7-linux-amd64/Documentation/faq.md
etcd-v2.3.7-linux-amd64/Documentation/api_v3.md
etcd-v2.3.7-linux-amd64/Documentation/runtime-reconf-design.md
etcd-v2.3.7-linux-amd64/Documentation/clustering.md
etcd-v2.3.7-linux-amd64/Documentation/proxy.md
etcd-v2.3.7-linux-amd64/Documentation/branch_management.md
etcd-v2.3.7-linux-amd64/Documentation/other_apis.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-2-2-0-rc-memory-benchmarks.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-3-demo-benchmarks.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-2-2-0-benchmarks.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-2-1-0-alpha-benchmarks.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-storage-memory-benchmark.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/README.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-2-2-0-rc-benchmarks.md
etcd-v2.3.7-linux-amd64/Documentation/benchmarks/etcd-3-watch-memory-benchmark.md
etcd-v2.3.7-linux-amd64/Documentation/api.md
etcd-v2.3.7-linux-amd64/Documentation/authentication.md
etcd-v2.3.7-linux-amd64/Documentation/04_to_2_snapshot_migration.md
etcd-v2.3.7-linux-amd64/Documentation/upgrade_2_3.md
etcd-v2.3.7-linux-amd64/Documentation/production-users.md
etcd-v2.3.7-linux-amd64/README-etcdctl.md
etcd-v2.3.7-linux-amd64/etcdctl
etcd-v2.3.7-linux-amd64/etcd
etcd-v2.3.7-linux-amd64/README.md
[root@ubuntu ~]$

 

该脚本从 github 上下载 etcd 的可执行文件并保存到 /usr/local/bin/，启动 etcd 并打开 2379 监听端口。

etcd -listen-client-urls http://10.12.31.21:2379 -advertise-client-urls http://10.12.31.21:2379

[root@ubuntu ~]$etcd -listen-client-urls http://10.12.31.21:2379 -advertise-client-urls http://10.12.31.21:2379
2019-03-27 23:22:33.110359 I | etcdmain: etcd Version: 2.3.7
2019-03-27 23:22:33.110422 I | etcdmain: Git SHA: fd17c91
2019-03-27 23:22:33.110430 I | etcdmain: Go Version: go1.6.2
2019-03-27 23:22:33.110437 I | etcdmain: Go OS/Arch: linux/amd64
2019-03-27 23:22:33.110444 I | etcdmain: setting maximum number of CPUs to 2, total number of available CPUs is 2
2019-03-27 23:22:33.110451 W | etcdmain: no data-dir provided, using default data-dir ./default.etcd
2019-03-27 23:22:33.110705 I | etcdmain: listening for peers on http://localhost:2380
2019-03-27 23:22:33.110802 I | etcdmain: listening for peers on http://localhost:7001
2019-03-27 23:22:33.110840 I | etcdmain: listening for client requests on http://10.12.31.21:2379
2019-03-27 23:22:33.114237 I | etcdserver: name = default
2019-03-27 23:22:33.114254 I | etcdserver: data dir = default.etcd
2019-03-27 23:22:33.114259 I | etcdserver: member dir = default.etcd/member
2019-03-27 23:22:33.114264 I | etcdserver: heartbeat = 100ms
2019-03-27 23:22:33.114271 I | etcdserver: election = 1000ms
2019-03-27 23:22:33.114278 I | etcdserver: snapshot count = 10000
2019-03-27 23:22:33.114288 I | etcdserver: advertise client URLs = http://10.12.31.21:2379
2019-03-27 23:22:33.114297 I | etcdserver: initial advertise peer URLs = http://localhost:2380,http://localhost:7001
2019-03-27 23:22:33.114310 I | etcdserver: initial cluster = default=http://localhost:2380,default=http://localhost:7001
2019-03-27 23:22:33.141747 I | etcdserver: starting member ce2a822cea30bfca in cluster 7e27652122e8b2ae
2019-03-27 23:22:33.141853 I | raft: ce2a822cea30bfca became follower at term 0
2019-03-27 23:22:33.141900 I | raft: newRaft ce2a822cea30bfca [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
2019-03-27 23:22:33.141915 I | raft: ce2a822cea30bfca became follower at term 1
2019-03-27 23:22:33.142350 I | etcdserver: starting server... [version: 2.3.7, cluster version: to_be_decided]
2019-03-27 23:22:33.143380 N | etcdserver: added local member ce2a822cea30bfca [http://localhost:2380 http://localhost:7001] to cluster 7e27652122e8b2ae
2019-03-27 23:22:33.143968 E | etcdmain: failed to notify systemd for readiness: No socket
2019-03-27 23:22:33.144218 E | etcdmain: forgot to set Type=notify in systemd service file?
2019-03-27 23:22:33.542474 I | raft: ce2a822cea30bfca is starting a new election at term 1
2019-03-27 23:22:33.542972 I | raft: ce2a822cea30bfca became candidate at term 2
2019-03-27 23:22:33.543300 I | raft: ce2a822cea30bfca received vote from ce2a822cea30bfca at term 2
2019-03-27 23:22:33.543575 I | raft: ce2a822cea30bfca became leader at term 2
2019-03-27 23:22:33.543814 I | raft: raft.node: ce2a822cea30bfca elected leader ce2a822cea30bfca at term 2
2019-03-27 23:22:33.544664 I | etcdserver: published {Name:default ClientURLs:[http://10.12.31.21:2379]} to cluster 7e27652122e8b2ae
2019-03-27 23:22:33.544753 I | etcdserver: setting up the initial cluster version to 2.3
2019-03-27 23:22:33.557561 N | etcdserver: set the initial cluster version to 2.3

测试 etcd 是否可用：

etcdctl --endpoints=10.12.31.21:2379 set foo "bar"

etcdctl --endpoints=10.12.31.21:2379 get foo

可以正常在 etcd 中存取数据了。

 

-----------------------------引用来自--------------------------------------

https://mp.weixin.qq.com/s?__biz=MzIwMTM5MjUwMg==&mid=2653587799&idx=1&sn=a26c6c4a9681997031cd346224d01822&chksm=8d30814eba47085870ac9695411bc1943ee054baeb6920094256215112f5817b7a3874388c89&scene=21#wechat_redirect