{"id":2203,"date":"2020-09-11T11:12:29","date_gmt":"2020-09-11T03:12:29","guid":{"rendered":"http:\/\/blog.ywdevops.cn\/?p=2203"},"modified":"2024-01-10T11:22:52","modified_gmt":"2024-01-10T03:22:52","slug":"kafka","status":"publish","type":"post","link":"https:\/\/blog.ywdevops.cn\/index.php\/2020\/09\/11\/kafka\/","title":{"rendered":"kafka\u6d88\u606f\u7cfb\u7edf\u642d\u5efa(\u96c6\u7fa4)"},"content":{"rendered":"\n

\u4e00\u3001kafka\u7b80\u4ecb\uff1a<\/strong><\/p>\n\n\n\n

Kafka\u662f\u4e00\u4e2a\u5f00\u6e90\u7684\u5206\u5e03\u5f0f\u6d88\u606f\u5f15\u64ce\/\u6d88\u606f\u4e2d\u95f4\u4ef6\uff0c\u540c\u65f6Kafka\u4e5f\u662f\u4e00\u4e2a\u6d41\u5904\u7406\u5e73\u53f0\u3002Kakfa\u652f\u6301\u4ee5\u53d1\u5e03\/\u8ba2\u9605\u7684\u65b9\u5f0f\u5728\u5e94\u7528\u95f4\u4f20\u9012\u6d88\u606f\uff0c\u540c\u65f6\u5e76\u57fa\u4e8e\u6d88\u606f\u529f\u80fd\u6dfb\u52a0\u4e86Kafka Connect\u3001Kafka Streams\u4ee5\u652f\u6301\u8fde\u63a5\u5176\u4ed6\u7cfb\u7edf\u7684\u6570\u636e(Elasticsearch<\/a>\u3001Hadoop<\/a>\u7b49) <\/p>\n\n\n\n

Kafka\u6700\u6838\u5fc3\u7684\u6700\u6210\u719f\u7684\u8fd8\u662f\u4ed6\u7684\u6d88\u606f\u5f15\u64ce\uff0c\u6240\u4ee5Kafka\u5927\u90e8\u5206\u5e94\u7528\u573a\u666f\u8fd8\u662f\u7528\u6765\u4f5c\u4e3a\u6d88\u606f\u961f\u5217\u524a\u5cf0\u5e73\u8c37\u3002\u53e6\u5916\uff0cKafka\u4e5f\u662f\u76ee\u524d\u6027\u80fd\u6700\u597d\u7684\u6d88\u606f\u4e2d\u95f4\u4ef6\u3002 <\/p>\n\n\n\n

\u4e8c\u3001kafka\u67b6\u6784\uff1a<\/strong><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\u5728Kafka\u96c6\u7fa4(Cluster)\u4e2d\uff0c\u4e00\u4e2aKafka\u8282\u70b9\u5c31\u662f\u4e00\u4e2aBroker\uff0c\u6d88\u606f\u7531Topic\u6765\u627f\u8f7d\uff0c\u53ef\u4ee5\u5b58\u50a8\u57281\u4e2a\u6216\u591a\u4e2aPartition\u4e2d\u3002\u53d1\u5e03\u6d88\u606f\u7684\u5e94\u7528\u4e3aProducer\u3001\u6d88\u8d39\u6d88\u606f\u7684\u5e94\u7528\u4e3aConsumer\uff0c\u591a\u4e2aConsumer\u53ef\u4ee5\u4fc3\u6210Consumer Group\u5171\u540c\u6d88\u8d39\u4e00\u4e2aTopic\u4e2d\u7684\u6d88\u606f\u3002 <\/p>\n\n\n\n

\u6982\u5ff5\/\u5bf9\u8c61<\/td>\u8bf4\u660e<\/td><\/tr>
Broker <\/td> Kafka\u8282\u70b9 <\/td><\/tr>
Topic <\/td> \u4e3b\u9898\uff0c\u7528\u6765\u627f\u8f7d\u6d88\u606f <\/td><\/tr>
Partition <\/td> \u5206\u533a\uff0c\u7528\u4e8e\u4e3b\u9898\u5206\u7247\u5b58\u50a8 <\/td><\/tr>
Producer <\/td> \u751f\u4ea7\u8005\uff0c\u5411\u4e3b\u9898\u53d1\u5e03\u6d88\u606f\u7684\u5e94\u7528 <\/td><\/tr>
Consumer <\/td> \u6d88\u8d39\u8005\uff0c\u4ece\u4e3b\u9898\u8ba2\u9605\u6d88\u606f\u7684\u5e94\u7528 <\/td><\/tr>
Consumer Group <\/td> \u6d88\u8d39\u8005\u7ec4\uff0c\u7531\u591a\u4e2a\u6d88\u8d39\u8005\u7ec4\u6210 <\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

\u4e09\u3001\u90e8\u7f72\uff1a<\/strong><\/p>\n\n\n\n

\u73af\u5883\u51c6\u5907\uff1a<\/p>\n\n\n\n

kafka1\uff1acentos7\u7cfb\u7edf(\u5df2\u5b89\u88c5jdk\u73af\u5883)<\/p>\n\n\n\n

kafka2\uff1acentos7\u7cfb\u7edf (\u5df2\u5b89\u88c5jdk\u73af\u5883)<\/p>\n\n\n\n

kafka3\uff1acentos7\u7cfb\u7edf (\u5df2\u5b89\u88c5jdk\u73af\u5883)<\/p>\n\n\n\n

kafka\u7248\u672c\uff1akafka_2.13-2.6.0.tgz<\/p>\n\n\n\n

1\u3001\u5c06kafka\u538b\u7f29\u5305\u89e3\u538b\uff0c\u89e3\u538b\u540e\u79fb\u52a8\u5230\/usr\/local\/\u76ee\u5f55\u4e2d(\u4e09\u53f0\u673a\u5668\u76f8\u540c\u64cd\u4f5c)\uff0c\u5982\u56fe\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

2\u3001\u8fdb\u5165\u5230kafka\u76ee\u5f55\u4e2d\uff0c\u521b\u5efa\u65e5\u5fd7\u76ee\u5f55\uff0c\u5982\u56fe\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

3\u3001\u8fdb\u5165\u914d\u7f6e\u6587\u4ef6\u76ee\u5f55config\uff0c\u7f16\u8f91\u914d\u7f6e\u6587\u4ef6server.properties\uff0c\u5982\u56fe\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

\u4e0a\u56fe\u4e2d\u7684\u914d\u7f6e\u4e3a\u901a\u7528\u914d\u7f6e\uff0c\u4e09\u53f0\u673a\u5668\u90fd\u662f\u4e00\u6837\uff0c\u6307\u5b9azookeeper\u670d\u52a1\u5668\u7684\u65f6\u5019\uff0c\u5982\u679c\u6709\u591a\u53f0\uff0c\u6bcf\u53f0\u4e4b\u95f4\u7528\u9017\u53f7\u5206\u9694\u3002<\/p>\n\n\n\n

4\u3001\u63a5\u4e0b\u6765\u7ee7\u7eed\u7f16\u8f91\u914d\u7f6e\u6587\u4ef6 server.properties \uff0c\u6bcf\u4e2a\u8282\u70b9\u8981\u5206\u522b\u8bbe\u7f6ebroker.id\u7684\u503c\u548clisteners\u7684\u503c\uff0c\u5982\u56fe\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

\u6ce8\uff1a\u8282\u70b9IP\u5fc5\u987b\u8981\u5199\uff0c\u5426\u5219\u63a5\u6536\u4e0d\u5230\u6570\u636e\u7684<\/p>\n\n\n\n

5\u3001\u9632\u706b\u5899\u5f00\u653e9092\u7aef\u53e3\uff0c\u6267\u884c\u547d\u4ee4\u5982\u4e0b\uff1a<\/p>\n\n\n\n

firewall-cmd –zone=public –add-port=9092\/tcp –permanent<\/p>\n\n\n\n

firewall-cmd –reload<\/p>\n\n\n\n

6\u3001\u542f\u52a8kafka<\/p>\n\n\n\n

\u8fdb\u5165\u5230bin\u76ee\u5f55\u4e0b\uff0c\u6267\u884c\u547d\u4ee4\u542f\u52a8\uff0c\u5982\u56fe\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

\u4e00\u3001kafka\u7b80\u4ecb\uff1a Kafka\u662f\u4e00\u4e2a\u5f00\u6e90\u7684\u5206\u5e03\u5f0f\u6d88\u606f\u5f15\u64ce\/\u6d88\u606f\u4e2d\u95f4\u4ef6\uff0c\u540c\u65f6Kafka\u4e5f\u662f\u4e00\u4e2a\u6d41\u5904\u7406\u5e73\u53f0\u3002Ka…<\/p>\n","protected":false},"author":3,"featured_media":2215,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34,22],"tags":[],"class_list":["post-2203","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-linux","category-server"],"_links":{"self":[{"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/posts\/2203","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/comments?post=2203"}],"version-history":[{"count":3,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/posts\/2203\/revisions"}],"predecessor-version":[{"id":15981,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/posts\/2203\/revisions\/15981"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/media\/2215"}],"wp:attachment":[{"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/media?parent=2203"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/categories?post=2203"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ywdevops.cn\/index.php\/wp-json\/wp\/v2\/tags?post=2203"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}