在Docker中快速体验StarRocks 2.5.3环境
Tags: docker环境docker镜像StarRocks快速体验
环境
1 2 3 4 5 6 7 8 9 | docker rm -f starrocks253 docker run -itd --name starrocks253 -h starrocks253 \ -p 9030:9030 -p 8030:8030 \ -v /sys/fs/cgroup:/sys/fs/cgroup \ --privileged=true lhrbest/starrocks:2.5.3 \ /usr/sbin/init docker exec -it starrocks253 bash |
启动StarRocks
1 2 | /usr/local/starrocks/fe/bin/start_fe.sh --daemon /usr/local/starrocks/be/bin/start_be.sh --daemon |
使用
1 2 3 4 5 | mysql -h 127.0.0.1 -P9030 -uroot SHOW frontends \G show backends \G |
web界面:http://172.18.0.14:8030/ 用户名:root 密码为空
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | [root@starrocks253 /]# mysql -h 127.0.0.1 -P9030 -uroot Welcome to the MariaDB monitor. Commands end with ; or \g. Your MySQL connection id is 1 Server version: 5.1.0 StarRocks version 2.5.3 Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. MySQL [(none)]> SHOW frontends ; +------------------------------+-----------+-------------+----------+-----------+---------+--------+------------+------+-------+-------------------+---------------------+----------+--------+---------------------+---------------+ | Name | IP | EditLogPort | HttpPort | QueryPort | RpcPort | Role | ClusterId | Join | Alive | ReplayedJournalId | LastHeartbeat | IsHelper | ErrMsg | StartTime | Version | +------------------------------+-----------+-------------+----------+-----------+---------+--------+------------+------+-------+-------------------+---------------------+----------+--------+---------------------+---------------+ | 127.0.0.1_9010_1680064832570 | 127.0.0.1 | 9010 | 8030 | 9030 | 9020 | LEADER | 1723834094 | true | true | 2536 | 2023-03-29 15:15:47 | true | | 2023-03-29 15:13:57 | 2.5.3-46bf084 | +------------------------------+-----------+-------------+----------+-----------+---------+--------+------------+------+-------+-------------------+---------------------+----------+--------+---------------------+---------------+ 1 row in set (0.02 sec) MySQL [(none)]> show backends; +-----------+-----------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------------------+-----------+------------------+---------------+---------------+---------+----------------+--------+---------------+--------------------------------------------------------+-------------------+-------------+----------+-------------------+------------+------------+ | BackendId | IP | HeartbeatPort | BePort | HttpPort | BrpcPort | LastStartTime | LastHeartbeat | Alive | SystemDecommissioned | ClusterDecommissioned | TabletNum | DataUsedCapacity | AvailCapacity | TotalCapacity | UsedPct | MaxDiskUsedPct | ErrMsg | Version | Status | DataTotalCapacity | DataUsedPct | CpuCores | NumRunningQueries | MemUsedPct | CpuUsedPct | +-----------+-----------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------------------+-----------+------------------+---------------+---------------+---------+----------------+--------+---------------+--------------------------------------------------------+-------------------+-------------+----------+-------------------+------------+------------+ | 11001 | 127.0.0.1 | 9050 | 9060 | 8040 | 8060 | 2023-03-29 15:13:57 | 2023-03-29 15:15:52 | true | false | false | 79 | 27.525 KB | 519.123 GB | 1019.104 GB | 49.06 % | 49.06 % | | 2.5.3-46bf084 | {"lastSuccessReportTabletsTime":"2023-03-29 15:14:58"} | 519.123 GB | 0.00 % | 16 | 0 | 0.34 % | 0.0 % | +-----------+-----------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------------------+-----------+------------------+---------------+---------------+---------+----------------+--------+---------------+--------------------------------------------------------+-------------------+-------------+----------+-------------------+------------+------------+ 1 row in set (0.01 sec) MySQL [(none)]> mysql> show databases; +--------------------+ | Database | +--------------------+ | _statistics_ | | example_db | | information_schema | | lhrdb | | sbtest | +--------------------+ 5 rows in set (0.08 sec) |
您可以运行以下 SQL 确认 StarRocks 是否部署成功。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 | CREATE DATABASE db1; USE db1; CREATE TABLE `sr_on_mac` ( `c0` int(11) NULL COMMENT "", `c1` date NULL COMMENT "", `c2` datetime NULL COMMENT "", `c3` varchar(65533) NULL COMMENT "" ) ENGINE=OLAP DUPLICATE KEY(`c0`) PARTITION BY RANGE (c1) ( START ("2022-02-01") END ("2022-02-10") EVERY (INTERVAL 1 DAY) ) DISTRIBUTED BY HASH(`c0`) BUCKETS 1 PROPERTIES ( "replication_num" = "1", "in_memory" = "false", "storage_format" = "DEFAULT" ); insert into sr_on_mac values (1, '2022-02-01', '2022-02-01 10:47:57', '111'); insert into sr_on_mac values (2, '2022-02-02', '2022-02-02 10:47:57', '222'); insert into sr_on_mac values (3, '2022-02-03', '2022-02-03 10:47:57', '333'); select * from sr_on_mac where c1 >= '2022-02-02'; |
如果无错误返回,则表明您已成功在 Docker 环境中部署 StarRocks。
1 2 3 4 5 6 7 8 9 | mysql> select * from sr_on_mac where c1 >= '2022-02-02'; +------+------------+---------------------+------+ | c0 | c1 | c2 | c3 | +------+------------+---------------------+------+ | 3 | 2022-02-03 | 2022-02-03 10:47:57 | 333 | | 2 | 2022-02-02 | 2022-02-02 10:47:57 | 222 | +------+------------+---------------------+------+ 2 rows in set (0.16 sec) |
添加broker
1 2 3 4 5 6 7 8 9 10 11 12 13 | MySQL [(none)]> show broker; Empty set (0.01 sec) MySQL [(none)]> ALTER SYSTEM ADD BROKER broker_name "127.0.0.1:8000"; Query OK, 0 rows affected (0.04 sec) MySQL [(none)]> show broker; +-------------+-----------+------+-------+---------------------+---------------------+--------+ | Name | IP | Port | Alive | LastStartTime | LastUpdateTime | ErrMsg | +-------------+-----------+------+-------+---------------------+---------------------+--------+ | broker_name | 127.0.0.1 | 8000 | true | 2023-03-30 09:32:54 | 2023-03-30 09:32:54 | | +-------------+-----------+------+-------+---------------------+---------------------+--------+ 1 row in set (0.00 sec) |
通过 Broker,StarRocks 可读取对应数据源(如HDFS、S3)上的数据,利用自身的计算资源对数据进行预处理和导入。除此之外,Broker 也被应用于数据导出,备份恢复等功能。
通过以下命令启动 Broker。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | /usr/local/starrocks/apache_hdfs_broker/bin/start_broker.sh --daemon ps -ef|grep broker netstat -tulnp | grep 8000 mysql -h 127.0.0.1 -P9030 -uroot ALTER SYSTEM ADD BROKER broker_name "127.0.0.1:8000"; MySQL [(none)]> show broker; Empty set (0.01 sec) MySQL [(none)]> ALTER SYSTEM ADD BROKER broker_name "127.0.0.1:8000"; Query OK, 0 rows affected (0.04 sec) MySQL [(none)]> show broker; +-------------+-----------+------+-------+---------------------+---------------------+--------+ | Name | IP | Port | Alive | LastStartTime | LastUpdateTime | ErrMsg | +-------------+-----------+------+-------+---------------------+---------------------+--------+ | broker_name | 127.0.0.1 | 8000 | true | 2023-03-30 09:32:54 | 2023-03-30 09:32:54 | | +-------------+-----------+------+-------+---------------------+---------------------+--------+ 1 row in set (0.00 sec) |
当 Alive
为 true
时,当前 Broker 节点正常接入集群。