社区智慧合集TiDB相关SQL脚本大全

网友投稿 256 2024-03-10



简介:

社区智慧合集TiDB相关SQL脚本大全

来自社区,回归社区。非常感谢各位 TiDBer 在之前 【TiDBer 唠嗑茶话会 48】非正式 TiDB相关 SQL 脚本征集大赛! 里提供的各种常用脚本。这篇专栏文章收集整理了大家推荐的 TiDB 相关 SQL 脚本大全。迎各位 TiDBer 持续补充更新~

1. 缓存表:

贡献者:@ShawnYanalter table xxx cache|nocache;

2. TSO时间转换:

贡献者: @我是咖啡哥方法一:使用函数TIDB_PARSE_TSOSELECT TIDB_PARSE_TSO(437447897305317376); +------------------------------------+ | TIDB_PARSE_TSO(437447897305317376) | +------------------------------------+ | 2022-11-18 08:28:17.704000 | +------------------------------------+ 1 row in set (0.25 sec) 方法二:使用pd-ctl~$ tiup ctl:v6.4.0 pd -i -u http://pdip:2379 Starting component `ctl`: /Users/xxx/.tiup/components/ctl/v6.4

3. 读取历史数据

贡献者: @我是咖啡哥使用 AS OF TIMESTAMP 语法读取历史数据,可以通过以下三种方式使用 AS OF TIMESTAMP 语法:

SELECT … FROM … AS OF TIMESTAMPSTART TRANSACTION READ ONLY AS OF TIMESTAMPSET TRANSACTION READ ONLY AS OF TIMESTAMP

select * from t as of timestamp 2021-05-26 16:45:26; start transaction read only as of timestamp 2021-05-26 16:45:26; set transaction read only as of timestamp 2021-05-26 16:45:26;通过系统变量 tidb_read_staleness 读取历史数据

从 5 秒前至现在的时间范围内选择一个尽可能新的时间戳

set @@tidb_read_staleness="-5";通过系统变量 tidb_snapshot 读取历史数据

设置一个特殊的环境变量,这个是一个 session scope 的变量,其意义为读取这个时间之前的最新的一个版本

set @@tidb_snapshot="2016-10-08 16:45:26";

清空这个变量后,即可读取最新版本数据

set @@tidb_snapshot=“”;

4. 查询tikv_gc_life_time和tikv_gc_safe_point默认时长

贡献者: @TiDBer_m6V1BalMselect VARIABLE_NAME, VARIABLE_VALUE from mysql.tidb where VARIABLE_NAME like “tikv_gc%;

5. 搜索某个用户的TopN慢查询

贡献者:@fanruinetselect query_time,query,user from information_schema.slow_query where is_internal=false -- 排除 TiDB 内部的慢查询 SQL and user = "user1" -- 查找的用户名 order by query_time desc limit 2;

6. 统计间隔5分钟的数据

贡献者:@foreverSELECT concat(date_format(create_time,‘%Y-%m-%d %H:’),floor(date_format(create_time,‘%i’)/5)),count(*) FROM jcxx GROUP BY 1;

7. 反解析digest成SQL文本

贡献者:@hey-hohoselect tidb_decode_sql_digests(‘[“xxxxx”]’);

8. 不涉及分区表用下面的方式查看表的使用情况:

贡献者:@xfworldselect TABLE_SCHEMA,TABLE_NAME,TABLE_ROWS, (DATA_LENGTH+INDEX_LENGTH)/1024/1024/1024 as table_size from tables order by table_size desc limit 20;

9. partition表提供了分区表和非分区表的资源使用情况:

贡献者:@xfworldselect TABLE_SCHEMA,TABLE_NAME,PARTITION_NAME,TABLE_ROWS, (DATA_LENGTH+INDEX_LENGTH)/1024/1024/1024 as table_size from information_schema.PARTITIONS order by table_size desc limit 20;

10. 查询分析器中看配置文件参数:

贡献者:@Kongdomshow config

SHOW CONFIG 语句用于展示 TiDB 各个组件当前正在应用的配置,请注意,配置与系统变量作用于不同维度,请不要混淆,如果希望获取系统变量信息,请使用 SHOW VARIABLES 语法。

11. 查找读流量排名前10的热点region

贡献者: @BraveChenSELECT DISTINCT region_id FROM INFORMATION_SCHEMA.tikv_region_status WHERE ORDER BY READ_BYTES DESC limit 10

12. 查看参数和变量的脚本

贡献者: @buddyyuan#!/bin/bash case $1 in -pd) mysql -uroot -h127.0.0.1 -P4000 -p"" -e "SHOW CONFIG WHERE type =pd and name like %$2%" ;; -tidb) mysql -uroot -h127.0.0.1 -P4000 -p"" -e "SHOW CONFIG WHERE type =tidb and name like %$2%" ;; -tikv) mysql -uroot -h127.0.0.1 -P4000 -p"" -e "SHOW CONFIG WHERE type =tikv and name like %$2%" ;; -tiflash) mysql -uroot -h127.0.0.1 -P4000 -p"" -e "SHOW CONFIG WHERE type =tiflash and name like %$2%" ;; -var) mysql -uroot -h127.0.0.1 -P4000 -p"" -e "show variables like %$2%;" ;; -h) echo "-pd show pd parameters" echo "-tidb show tidb parameters" echo "-tikv show tikv parameters" echo "-tiflash show tiflash parameters" echo "-var show itidb variables" ;; esac

还能用 grep 在过滤一次

[root@vm172-16-201-125 ~]# sh showparammeter.sh -tikv memory-pool-quota | grep -i "210:29160" tikv 192.16.201.210:29160 server.grpc-memory-pool-quota 9223372036854775807B

13. 查找重复记录

贡献者:@ealam_小羽select * fromwhere 重复字段 in ( select 重复字段 fromgroup by 重复字段 having count(*)>1 )

14. 查询耗时最高的慢sql

贡献者:@caiyfcselect query sql_text, sum_query_time, mnt as executions, avg_query_time, avg_proc_time, avg_wait_time, max_query_time, avg_backoff_time, Cop_proc_addr, digest, (case when avg_proc_time = 0 then point_get or commit when (avg_proc_time> avg_wait_time and avg_proc_time > avg_backoff_time) then coprocessor_process when (avg_backoff_time > avg_wait_time and avg_proc_time < avg_backoff_time) then backoff else coprocessor_wait end) as type from (select substr(query, 1, 100) query, count(*) mnt, avg(query_time) avg_query_time, avg(process_time) avg_proc_time, avg(wait_time) avg_wait_time, max(query_time) max_query_time, sum(query_time) sum_query_time, digest, Cop_proc_addr, avg(backoff_time) avg_backoff_time from information_schema.cluster_slow_query where time >= 2022-07-14 17:00:00 and time <= 2022-07-15 17:10:00 and DB = web group by substr(query, 1, 100)) t order by max_query_time desc limit 20;

15. 日常维护用的最多的SQL

贡献者:@tracy0984select * from information_schema.cluster_processlist;kill id;

16. 恢复数据(适用于drop与truncate)

贡献者:@凌云CloudFLASHBACK TABLE target_table_name[TO new_table_name]

17. 批量修改库名

贡献者:@TiDBer_dog./bat_rename.sh lihongbao/ dev2_kelun dev2_sinodemo 路径./leo_backup

18. 高并发的场景下 获取sql

贡献者:@jiaweiselect * from information_schema.processlist where info is not null

19. 查看schema下的表都有哪些

贡献者:@Mingshow tables in schema;

20. 查看表leader

贡献者: @TiDBer_wTKU9jv6

select count(1),tss.ADDRESS from INFORMATION_SCHEMA.TIKV_REGION_PEERS trp,INFORMATION_SCHEMA.TIKV_REGION_STATUS trs,INFORMATION_SCHEMA.TIKV_STORE_STATUS tss where trp.STORE_ID=tss.STORE_ID and trp.REGION_ID=trs.REGION_ID and trs.DB_NAME=‘test’ and trs.TABLE_NAME=‘test’ and trp.IS_LEADER=1 group by tss.ADDRESS order by tss.ADDRESS;

21. shell的调皮加速脚本

贡献者:@gcworkerishungryalias ctidb=“mysql -u root -ptidb -Dcktest -h S001 -P4000” alias dtidb=“tiup cluster display tidb-test” alias etidb=“tiup cluster edit-config tidb-test” alias ptidb=“tiup cluster prune tidb-test” alias rtidb=“tiup cluster restart tidb-test”

22. 恢复数据到新的数据库

贡献者:@TiDBer_徐川./loader -h 192.168.180.3 -u root -p q1w2 -P 4000 -t 32 -d leo_backup/

23. 开启 tiflash

贡献者:@TiDBer_pFFcXLgYalter table xxx set tiflash replica 1

24. 表region分布语句:

贡献者:@秋枫之舞select trs.db_name, trs.table_name, trs.index_name, trp.store_id, count(*), sum(approximate_keys) from information_schema.tikv_region_status trs, information_schema.tikv_store_status tss, information_schema.tikv_region_peers trp where trs.db_name = ‘prd01’ and trs.table_name = ‘tab_name’ and trp.is_leader = 1 and trp.store_id = tss.store_id and trs.region_id = trp.region_id group by trs.db_name, trs.table_name, trs.index_name, trp.store_id order by trs.index_name;

25. 查看列的元数据

贡献者:@张雨齐0720show stats_histograms where db_name like ‘test’ and table_name like ‘test1’ ;

26. 表的存储位置(store、peer信息)

贡献者:@bertSELECT distinct a.TIDB_TABLE_ID, b.DB_NAME, b.TABLE_NAME, b.REGION_ID, b.APPROXIMATE_SIZE , c.PEER_ID, c.STORE_ID, c.IS_LEADER, c.STATUS, d.ADDRESS , d.STORE_STATE_NAME, d.VERSION, d.CAPACITY, d.AVAILABLE, d.LABEL FROM INFORMATION_SCHEMA.TABLES a INNER JOIN INFORMATION_SCHEMA.TIKV_REGION_STATUS b INNER JOININFORMATION_SCHEMA.TIKV_REGION_PEERS c INNER JOIN INFORMATION_SCHEMA.TIKV_STORE_STATUS d WHERE a.TIDB_TABLE_ID = b.TABLE_ID AND b.REGION_ID = c.REGION_ID AND c.STORE_ID = d.STORE_ID AND a.TABLE_SCHEMA = ‘test’ AND a.TABLE_NAME = ‘t’;

27. 将集群升级到指定版本 ( 在线升级 ) :

贡献者:@TiDBer_杨龟干外公tiup cluster upgrade

例如升级到 v4.0.0 版本:tiup cluster upgrade tidb-test v4.0.0

28. 查询表大小

贡献者:@我是咖啡哥SELECT t.TABLE\_NAME, t.TABLE\_ROWS, t.TABLE\_TYPE, round(t.DATA\_LENGTH/1024/1024/1024,2) data\_GB, round(t.INDEX\_LENGTH/1024/1024/1024,2) index\_GB, t.CREATE\_OPTIONS, t.TABLE\_COMMENT FROM INFORMATION\_SCHEMA.`TABLES` t WHERE table\_schema = test and t.table\_type=BASE TABLE order by t.TABLE\_ROWS desc; SELECT CONCAT(table\_schema,.,table\_name) AS Table Name, table\_rows AS Number of Rows, CONCAT(ROUND(data\_length/(1024*1024*1024),4),G) AS Data Size, CONCAT(ROUND(index\_length/(1024*1024*1024),4),G) AS Index Size, CONCAT(ROUND((data\_length+index\_length)/(1024*1024*1024),4),G) ASTotal FROM information\_schema.TABLES WHERE table\_schema LIKE test;

29. 统计信息

贡献者:@我是咖啡哥

查看表的元数据

show stats\_meta where db\_name like %sbtest%;

查看表的健康状态

show stats\_healthy;

Healthy 字段,一般小于等于 60 的表需要做 analyze

show stats\_healthy where table\_name =xxx; show stats\_healthy where db\_name= and table\_name=orders;

_name like ‘sbtest’ and table_name like ‘sbtest1’ ;

查看直方图信息

show stats\_buckets where db\_name= and table\_name=;

查看analyze状态

show analyze status;

分析表、分区

analyze table sbtest1; ANALYZE TABLE xxx PARTITION P202204;

30. 执行计划

贡献者:@我是咖啡哥

绑定执行计划

默认是session级别create binding for select \* from t using select \* from t use index() create binding for SELECT \* FROM t1 INNER JOIN t2 ON t1.id = t2.t1\_id WHERE t1.int\_col =using SELECT /\*+ INL\_JOIN(t1, t2) \*/ \* FROM t1 INNER JOIN t2 ON t1.id = t2.t1\_id WHERE t1.int\_col =; explain SELECT \* FROM t1 INNER JOIN t2 ON t1.id = t2.t1\_id WHERE t1.int\_col = 1; show bindings for SELECT \* FROM t1 INNER JOIN t2 ON t1.id = t2.t1\_id WHERE t1.int\_col = 1; show global bindings; show session bindings; SELECT @@SESSION.last\_plan\_from\_binding;使用 explain format = ‘verbose’ 语句查看 SQL 的执行计划explain format = verbose; drop binding for sql;

31. 查看regions

贡献者:@我是咖啡哥SHOW TABLE t\_its\_unload\_priority\_intermediate\_info regions; SHOW TABLE t\_its\_unload\_priority\_intermediate\_info INDEXIDX\_UPII\_GROUP\_BY\_COMPOSITE regions;

32. 统计读写热点表

贡献者:@我是咖啡哥use INFORMATION\_SCHEMA; SELECT db\_name, table\_name, index\_name, type, sum( flow\_bytes ), count( 1 ), group\_concat( h.region\_id ), count( DISTINCT p.store\_id ), group\_concat( p.store\_id ) FROM INFORMATION\_SCHEMA.tidb\_hot\_regions h JOIN INFORMATION\_SCHEMA.tikv\_region\_peers pON h.region\_id = p.region\_id AND p.is\_leader = 1 GROUP BY db\_name, table\_name, index\_name, type; SELECT p.store\_id, sum(flow\_bytes ), count(

版权声明:本文内容由网络用户投稿,版权归原作者所有,本站不拥有其著作权,亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容,请联系我们jiasou666@gmail.com 处理,核实后本网站将在24小时内删除侵权内容。

上一篇:监控告警处理 TiDB server critical error total指标分析
下一篇:神州数码集团荣获TiDB社区最佳贡献企业
相关文章