求仁得仁
  文章分类
工作笔记 4 算法笔记 14 交易学习笔记 59 作品 17 读书笔记 55 思考 26 private 1 交易笔记 21 学习笔记 6 索引 3 英语学习笔记 2 IT学习笔记 205 template 130 排错笔记 17 逆向工程 4 运维手册 65
Storm-单机部署 Storm-单机部署
version: '3.8' services: zookeeper: image: zookeeper restart: unless-stopped nimbus: image: storm
2023-04-26 运维手册
docker-compose.yml Storm
Flink-单机部署 Flink-单机部署
version: "3.8" services: jobmanager: image: flink expose: - "6123" ports: - "8081:8081" en
2023-04-26 运维手册
docker-compose.yml Flink
Spark-集群部署[DockerSwarm] Spark-集群部署[DockerSwarm]
version: '3.8' services: master: image: bitnami/spark user: root environment: - SPARK_MODE=master
2023-04-26 运维手册
docker-compose.yml Spark
Spark-单机部署 Spark-单机部署
version: '3.8' services: master: image: bitnami/spark user: root environment: - SPARK_MODE=master
2023-04-26 运维手册
docker-compose.yml Spark
Jenkins-Ubuntu安装Jenkins Jenkins-Ubuntu安装Jenkins
不建议使用 Docker 运行 Jenkins # 安装 Java apt update apt install openjdk-11-jdk java --version # 安装 Jenkins curl -fsSL https://
2023-04-26 运维手册
Jenkins
MinIO-单机部署 MinIO-单机部署
version: '3.8' services: minio: image: 'minio/minio:latest' ports: - '9000:9000' - '9001:9001'
2023-04-24 运维手册
docker-compose.yml MinIO
Hadoop-Sqoop-安装 Hadoop-Sqoop-安装
tar -zxvf 解压 sqoop-env.sh export HADOOP_COMMON_HOME= export HADOOP_MAPRED_HOME= export HIVE_HOME= export ZOOKEEPER_HOME
2023-04-23 运维手册
Hadoop Sqoop
Hadoop-HBase-Hive-集成 Hadoop-HBase-Hive-集成
HBase 提供的查询主要还是通过 key 的方式进行的，相比 hive，hbase 的查询要薄弱很多。Hive 整合 HBase 后的使用场景: 通过 Hive 把数据加载到 HBase 中，数据源可以是文件也可以是 Hive 中的表
2023-04-23 运维手册
HBase Hadoop Hive
Hadoop-HBase-高可用集群部署 Hadoop-HBase-高可用集群部署
启动 Hadoop 集群: Hadoop-集群部署 | Hadoop-高可用集群部署 启动 Zookeeper 集群: Zookeeper-高可用集群部署[DockerSwarm] 修改 HBase 配置文件 hbase-env.sh
2023-04-23 运维手册
HBase Hadoop
Hadoop-Hive-安装 Hadoop-Hive-安装
安装 tar -zxvf apache-hive-3.1.3-bin.tar.gz -C /opt/hive cp hive-env.sh.template hive-env.sh hive-env.sh export JAVA_HOME
2023-04-22 运维手册
Hadoop Hive
Hadoop-高可用集群部署 Hadoop-高可用集群部署
架构示例 主机名 IP 服务 进程 HA1 192.168.140.130 Hadoop NN(active), ZKFC HA2 192.168.140.131 Hadoop NN(standby), ZKFC H
2023-04-22 运维手册
Hadoop
Zookeeper-高可用集群部署[DockerSwarm] Zookeeper-高可用集群部署[DockerSwarm]
docker-compose.yml version: '3.8' services: zoo1: image: zookeeper hostname: zoo1 ports: - 2181:218
2023-04-21 运维手册
docker-compose.yml Zookeeper
DockerSwarm-初始化 DockerSwarm-初始化
# 初始化 swarm docker swarm init # 查看如何加入本机 swarm 的命令 docker swarm join-token manager docker swarm join-token worker # 查看
2023-04-21 运维手册
Docker
Hadoop-集群部署 Hadoop-集群部署
示例: IP(Hostname) Server 192.168.140.130 (hadoop01) Nn Dn Snn Nm 192.168.140.131 (hadoop02) Dn Nm Rm 192.168.1
2023-04-19 运维手册
Hadoop
Hadoop-单机伪分布式部署 Hadoop-单机伪分布式部署
配置网络环境 vi /etc/hosts: 192.168.140.130 hadoop vi /etc/hostname: hadoop 关闭防火墙 systemctl stop firewalld.service systemct
2023-04-19 运维手册
Hadoop
Hadoop2-集群部署[DockerCompose] Hadoop2-集群部署[DockerCompose]
docker-compose.yml version: "3.8" services: namenode: image: bde2020/hadoop-namenode:2.0.0-hadoop3.2.1-java8
2023-04-17 运维手册
docker-compose.yml Hadoop
PostgreSQL-部署 PostgreSQL-部署
docker-compose.yml version: '3.8' services: postgres: image: postgres restart: unless-stopped ports:
2023-04-14 运维手册
docker-compose.yml PostgreSQL
Dockerfile-Nginx部署静态页面 Dockerfile-Nginx部署静态页面
Dockerfile FROM nginx:stable-alpine-slim COPY ./dist /usr/share/nginx/html COPY ./default.conf /etc/nginx/conf.d/ RUN ch
2023-04-05 运维手册
Dockerfile Nginx
3 / 4