Ubuntu Server 18.04 xclip 使用指南

2020-04-24

需求 (Feature)

通过 ssh 连远程 ubuntu server(18.04) 时经常会需要通过 vim 编辑文件 copy 一些代码，或者通过 tmux 复制 shell 命令，此时如果需要 paste 到本地每次都需要使用鼠标选中，极其麻烦，对于键盘党来说太不友好，偶然听说 xclip 可以解决这个问题，于是开始了折腾。中间过程中意外解决了以前遇到的一些杂症，甚是神奇。

介绍 (Introduce)

`X`

图形界面并不是 Linux 的一部分，和 Windows95 及以后的版本就不一样了，他们的图形界面是操作系统的一部分，图形界面在系统内核中就实现了
X 是协议，一个基于X的应用程序需要运行并显示内容时会连接到 X 服务器，开始用X协议和服务器通信
X11 是指 X Protocol version 11

安装 (Installation)

Ubuntu 安装 `xclip`

1	apt install -y xclip

OSX 安装 `XQuartz`

The XQuartz project is an open-source effort to develop a version of the X.Org X Window System that runs on OS X.

官方网站 https://www.xquartz.org/

装完之后需要重新登陆系统
配置 Application ，将 xterm 替换成 iTerm 的运行路径 /Applications/iTerm.app/Contents/MacOS/iTerm2
检查是否配置成功，iTerm 内执行 echo $DISPLAY

配置 (Configuration)

客户端 `ssh` 配置

检查是否已经启用 X11

1	cat /etc/ssh/ssh_config

确认输出包含

1 2	Host * ForwardX11 yes

ssh 连接时添加 -X 参数

1	ssh -X root@host

服务端 `ssh` 配置

1	cat /etc/ssh/sshd_config

确认输出包含

1	X11Forwarding yes

服务端 `~/.tmux.conf` 配置

# copy to Mac OSX clipboard
if -b 'command -v reattach-to-user-namespace > /dev/null 2>&1' 'bind y run -b "tmux save-buffer - | reattach-to-user-namespace pbcopy"'
# copy to X11 clipboard
if -b 'command -v xsel > /dev/null 2>&1' 'bind y run -b "tmux save-buffer - | xsel -i -b"'
if -b '! command -v xsel > /dev/null 2>&1 && command -v xclip > /dev/null 2>&1' 'bind y run -b "tmux save-buffer - | xclip -i -selection clipboard >/dev/null 2>&1"'
# copy to Windows clipboard
if -b 'command -v clip.exe > /dev/null 2>&1' 'bind y run -b "tmux save-buffer - | clip.exe"'
if -b '[ -c /dev/clipboard ]' 'bind y run -b "tmux save-buffer - > /dev/clipboard"'

服务端 `~/.vimrc` 配置

" y
set clipboard=unnamedplus
" copy the filepath of current buff to clipboard
nmap <Leader>c :call system("xclip -i -selection c", expand("%:p"))<CR>

" osx
if !executable('xclip')
  set clipboard=unnamed
  nmap <Leader>c :let @+=expand('%:p')<CR>
endif

Trouble Shooting

vim 配置好了之后为什么不生效?

确认 vim +clipboard 已经开启，vim --version | grep clipboard，推荐使用 vim-gtk 代替系统默认 vim
mosh 不支持 X 协议 mosh/issues/41

意外解决的问题

vim 光标 之前一直用的系统默认 vim 发现 normal 和 insert 相互切换时光标没办法改变(box <-> vertical var)，换成 gvim 这个问题就解了
zsh 光标 没启用 X 之前一直也无法切换光标形状，开启过后问题已解
<!–stackedit_data:
eyJoaXN0b3J5IjpbOTA2NzEyNDE2LDEwMjg2NzYyNzUsOTA2Nz
EyNDE2LDEwMTAzODg5MTMsLTM1Nzg3NDc5OCwtMTQzNzY1Mzcy
NSw2MjgxMzA1MjUsMTkzOTAzMjQ3MSw3NTgwNjQzNjAsMTc0Mj
M1NTkxOF19
->

ALL >>

过去半年，我做了什么，未来半年的计划

2020-03-24

离开了上一家公司

19年中，我离开了待了2年的一家创业公司，对于这家公司我的感情很深，最开始我只是一个前端的业务开发，那个时候人很少，只有一个前辈，加上我一共也才两个人，后来业务发展得比较快，又招了一个同事，我们三个人就开始努力地写业务，也没有leader什么的，当时部门的领导想让我们三个人中的某一个自己“冒”出来当leader😓，但业务实在太多了，我们根本就没有多余的时间来考虑这些（当时自己也是挺单纯的，没有什么杂七杂八的想法，只是一心想提升自己的技术），后来公司战略有所调整，从B端往C端开始发展，开始做小程序，于是开始了分业务线（大厂里应该叫事业部），又开始了新一轮扩张，当时招人很难，不是由HR筛选简历，而是让我直接在BOSS上自己联系😂，本来业务就多，哪来那么多时间呀，招聘这件事情就比较拖沓，从18年中到年底一共也才招了6个同事，而我也渐渐地开始脱离了业务，最开始的三人组中我成了前端leader，另外两个同事分别带2-4个人处理业务，其实很怀念当时的情景，和后端的同学感情也非常好，中午大家一起吃饭，晚上一起回家（有2个同事和我住同一个小区），周末偶尔一起出去玩，有时候还约一起玩游戏，想想感情真的好，就像大学同学一样，大家有啥就说啥，哈哈哈，坐的地方也挨着一起，随时扯皮。

19年初，我渐渐有了换一份工作的想法，部分原因是个人发展，感觉自己前进的步伐迈得愈发困难，还有一部分原因是感觉研发
、产品、测试之间的关系越来越矛盾，公司不大但内部消耗却有点严重，渐渐没有了那种做好事的感觉，大家一心想的是如何保证自己的舒适区，如何提高自己的话语权，就这么点人我也是醉了，哪来那么多弯弯绕绕呢。各方面原因吧，开始了自己人生中下一份工作。中间还有很多有意思的事情，我开个单章慢慢道来。

开始接触Devops

新公司也是一家创业公司，刚开始我也只是做业务，这里我得感谢一下在做业务的时候我的manager，亦师亦友，帮我争取了很多机会，差不多1个月左右我被拉去了infra team，开始了devops的旅程，我从infra team的manager身上学到了很多东西，他年长我几年，但是他的经历非常丰富，印象最深的就是他对待技术的态度，从不拖沓，想到就做，动不动就硬核改源码，当时我惊呆了，怎么会有这么吊的人，知识面很广，并且非常敢于表达自己的想法（这点我感觉自己差很多，总有点畏首畏尾），技术深度也有，以前我的想法是只要能用即可，但为什么却思考比较少，让我想起了高中学数学，总喜欢问为什么，所以成绩才好，毕业了出来工作了，反而缺失了追寻事物本质的态度，这点需要我自己反思。

开始完善方法论

我觉得做事情需要有方法和技巧。

方法 -> 如何高效并且最大化价值地完成一件事
技巧 -> 如何让过程变得简单，可执行，可预期

方法

行动之前先想好步骤（过程）
执行阶段需要熔断（BFS)
结果可积累（复利）

技巧

拆分步骤的思考流程：输出 - 输入 - 算法
每个步骤的预计执行时间不要超过一个番茄钟

未来的计划

把自己的人生看成是 `编程`

期望(output)
当前(input)
过程(algorithm)

几个小目标

瘦腰 & 腹肌
唱好几首歌
学会游泳
交几个女性朋友
开始一门副业

现在需要完善的体系

dev infra
- ide
- compound interest
dev ops
fe
- spa
- ssr
- js(ts) & css(css in js) & html
be

人生目标

为自己而活
自律
让自己变得高效
提升自己的执行力

ALL >>

The deps manager of go lang

2019-12-27

go mod

Go Modules have recently been released and announced as the official Go dependency management tool. A lot of Go 3rd libraries are being migrated to use Go Modules and require dependent projects to use Go Modules as well. Therefore, Go Dep is going to be deprecated soon. We will swap Dep for Go Modules in the project we previously started

Features

Allow and recommend projects to be located outside of $GOPATH.
Dependencies are put into a vendor directory (same as go-dep), so that different projects can depend on different versions of the same packages.
Automatically detect import statements and then update dependencies graph, lock, download, and install appropriate versions of packages.
Automatically check for dependencies when build, run, or test.
Allow specifying, downgrading, and upgrading versions of packages.
Automatically generate a dependency lock to ensure reproducible builds.
Semantic versioning mechanism.
The official recommendation for dependencies and applied in the Go ecosystem.

ALL >>

Shell Common Commands

2019-12-17

Traverse

# read lines from file
while read line; do
  echo $line
done < /path/to/file

Volume

1 2	# Show Mounted Hard Drives Partition df -aTh

Task

# parallel run task
wget url1 &
wget url2 &
wait

1 2	# calc command time time cp a_large_file .

Compress

# tar zip
tar -czf /path/to/archive.zip /src/to/be/zipped

# tar unzip
# notice: This will be extracted to /src/to/be/zipped
# not /zipped
tar -xzf /path/to/archive.zip -C /

Network

# check whether the site is healthy
curl -if https://xxx.xx/health-check

# curl: (48) An unknown option was passed in to libcurl
apk add curl-dev

# how to test gateway
kubectl -n istio-system port-forward svc/istio-ingressgateway 3000:80
curl -H "Host: www.xxx.com" http://localhost:3000

String

# base
# echo ${str:start-index} or echo ${str:start-index:length}
str='12345'
echo ${str:2} # 345
echo ${str:2:1} # 3
echo ${str: -2} # 45(there is a space beteew ':' and '-')

# cut
  # get Add and Modified files
git diff-tree --no-commit-id --name-status -r HEAD | grep '^[AM]' | cut -f 2

# rm last substring
filename=path-to-test-dev
str=$(echo ${filename%-*})
# path-to-test
echo $str

# regex
[[ "1234" =~ ^12 ]] && echo y

# trim
trim() {
    local var="$*"
    var="${var#"${var%%[![:space:]]*}"}"
    var="${var%"${var##*[![:space:]]}"}"
    echo -n "$var"
}
# 123 1221
trim ' 123 1221  '

# keep str format
cat <<- EOF
w	1w	1wasdfc
...str
EOF

JSON

# get json value
JSON='[{"a": "line\nnewline"}, {"a": "line1\nnewline"}]'
while read line; do
	echo $line | base64 --decode
done < <(echo $JSON | jq -r ".[].a | @base64")


# convert string to JSON
jq -aRs . <<< 'line
newline'

# use variable as JSON string
JSON_STRING='{"bucketname":"'"$BUCKET_NAME"'","objectname":"'"$OBJECT_NAME"'","targetlocation":"'"$TARGET_LOCATION"'"}'

Date

1	date -D "2019-12-11T07:25:34Z" "+%Y-%m-%d %H:%M:%S"

Process Subsititution

# grammar
# <(command) 或 >(command)
cat <(ls)
ls > >(cat)

while read -r line; do
  echo "$line"
done < <(ls)

ALL >>

Bazel Basic

2019-12-16

Concepts and Terminology

Workspace
Repositories
Packages
Targets
- files
  - source files
  - generated files
- rules
Labels
- labels belones to only the first parent package(otherwise, it will throw a error “crosses a package boundary”

Rules

Phases

It will be important to understand the three phases of a build (loading, analysis and execution)

Attributes

Dependency attributes, such as attr.label and attr.label_list, declare a dependency from the target that owns the attribute to the target whose label appears in the attribute’s value. This kind of attribute forms the basis of the target graph.

Output attributes, such as attr.output and attr.output_list, declare an output file that the target generates.

Both dependency attributes and output attributes take in label values.

Private Attribute

Sometimes we want to not only provide a default value, but prevent the user from overriding this default. To do this, you can make the attribute private by giving it a name that begins with an underscore (_). Private attributes must have default values. It generally only makes sense to use private attributes for implicit dependencies.

Implementation Function

Implementation functions take exactly one parameter: a rule context, conventionally named ctx. It can be used to:

access attribute values and obtain handles on declared input and output files;
create actions; and
pass information to other targets that depend on this one, via providers.

ALL >>

Git Shallow Clone

2019-12-03

How to clone a commit from a heavy repo ?

1	git clone --depth 1 https://github.com/xxx/yyy.git

But there is no more messages about commit history. How to resolve it?

git fetch --help

--unshallow
    Convert a shallow repository to a complete one, removing all the limitations imposed by shallow repositories.

ALL >>

Differences about Docker in k8s

2019-12-03

Difference between Docker ENTRYPOINT and Kubernetes container spec COMMAND

Kubernetes provides us with multiple options on how to use these commands:

When you override the default Entrypoint and Cmd in Kubernetes .yaml file, these rules apply:

If you do not supply command or args for a Container, the defaults defined in the Docker image are used.
If you supply a command but no args for a Container, only the supplied command is used. The default EntryPoint and the default Cmd defined in the Docker image are ignored.
If you supply only args for a Container, the default Entrypoint defined in the Docker image is run with the args that you supplied.
If you supply a command and args, the default Entrypoint and the default Cmd defined in the Docker image are ignored. Your command is run with your args.
<!–stackedit_data:
eyJoaXN0b3J5IjpbLTE1MTczNTI0OTFdfQ==
->

ALL >>

The Cache of React Pipeline

2019-12-02

Build Cache

我们在做pipeline相关优化的时候，一个很重要的指标就是构建时间，最基本的优化就是构建缓存。

基本思路就是每次 build 之前 restore 上次的缓存，构建完成后 rebuild 当前缓存。

cache 我们试过几种种:

node 上的 volume： EBS(RWO), EFS(RWX)等
s3

EBS只支持 ReadWriteOnly, EFS支持 ReadWriteMany，由于我们的pipeline很可能会同时构建多次，所以需要支持 RWX 的 EFS，最开始我们在尝试的时候发现如果直接缓存不 compress 的话，传输性能存在瓶颈，总体构建时间反而降低，所以在上传之前我们先使用 tar (no compress) archive 一下。

steps:
- name: restore-cache
  image: amazonlinux-cache
  workingDir: /workspace/src
  resources:
    requests:
      cpu: 2000m
  command:
  - /bin/sh
  args:
  - -c
  - |
    mkdir -p ${CACHE_FOLDER}
    export BUCKET_URL=s3://build-cache
    aws s3 cp ${BUCKET_URL}/$(inputs.params.REPO_NAME)/${NODE_MODULES_TAR_NAME} ${CACHE_FOLDER}/${NODE_MODULES_TAR_NAME} || true
    aws s3 cp ${BUCKET_URL}/$(inputs.params.REPO_NAME)/${BUILD_FILE_TAR_NAME} ${CACHE_FOLDER}/${BUILD_FILE_TAR_NAME} || true

    tar -xf ${CACHE_FOLDER}/${NODE_MODULES_TAR_NAME} -C / || true
    tar -xf ${CACHE_FOLDER}/${BUILD_FILE_TAR_NAME} -C / || true

- name: build-from-src
  volumeMounts:
  - name: npmrc
    mountPath: /builder/home/
  image: node:12
  workingDir: /workspace/src
  resources:
    requests:
      cpu: 4000m
  command:
  - /bin/sh
  args:
  - -c
  - |
    [ -d /workspace/src/node_modules ] && echo "node_modules has been restored from cache" || echo "node_modules cache not found"
    [ -d /workspace/src/$(inputs.params.pathToBuildCache) ] && echo "$(inputs.params.pathToBuildCache) has been restored from cache\n" || echo "$(inputs.params.pathToBuildCache) cache not found\n"
    echo "start building..."

    $(inputs.params.buildCommands)

- name: rebuild-cache
  image: amazonlinux-cache
  workingDir: /workspace/src
  resources:
    requests:
      cpu: 2000m
  env:
  - name: AWS_DEFAULT_REGION
    value: ap-northeast-1
  command:
  - /bin/sh
  args:
  - -c
  - |
    # check if skip
    if [ "$(inputs.params.skipRebuildCache)" == "true" ]; then
      echo 'rebuild cache is skipped'
      exit 0
    fi

    # tar
    export SRC_FOLDER=/workspace/src
    export NODE_MODULES_FOLDER=${SRC_FOLDER}/node_modules
    export BUILD_FOLDER=${SRC_FOLDER}/$(inputs.params.pathToBuildCache)

    mkdir -p ${CACHE_FOLDER}
    tar -cf ${CACHE_FOLDER}/${NODE_MODULES_TAR_NAME} ${NODE_MODULES_FOLDER} || true
    tar -cf ${CACHE_FOLDER}/${BUILD_FILE_TAR_NAME} ${BUILD_FOLDER} || true

    # upload
    export BUCKET_URL=s3://build-cache
    aws s3 cp ${CACHE_FOLDER}/${NODE_MODULES_TAR_NAME} ${BUCKET_URL}/$(inputs.params.REPO_NAME)/${NODE_MODULES_TAR_NAME}
    aws s3 cp ${CACHE_FOLDER}/${BUILD_FILE_TAR_NAME} ${BUCKET_URL}/$(inputs.params.REPO_NAME)/${BUILD_FILE_TAR_NAME}

Resources

webpack build cache
tekton
<!–stackedit_data:
eyJoaXN0b3J5IjpbLTc3NDQ4MzMyNiwtMTMxNjEyODAxMywtMT
UyMjcwMDM0Ml19
->

ALL >>

k8s pvc subPath

2019-12-01

我们希望将文件挂载到某个目录，但希望只是挂载该文件，不要影响挂载目录下的其他文件。有办法吗？

subPath 的目的是为了在单一Pod中多次使用同一个volume而设计的。

subPath: Path within the volume from which the container's volume should be mounted。

apiVersion: v1
kind: Pod
metadata:
  name: my-lamp-site
spec:
    containers:
    - name: mysql
      image: mysql
      env:
      - name: MYSQL_ROOT_PASSWORD
        value: "rootpasswd" 
      volumeMounts:
      - mountPath: /var/lib/mysql
        name: site-data
        subPath: mysql
    - name: php
      image: php:7.0-apache
      volumeMounts:
      - mountPath: /var/www/html
        name: site-data
        subPath: html
    volumes:
    - name: site-data
      persistentVolumeClaim:
        claimName: my-lamp-site-data

ALL >>

React Suspense

2019-11-22

Data fetch ways

Approach 1: Fetch-on-Render

function ProfilePage() {
  const [user, setUser] = useState(null);

  useEffect(() => {
    fetchUser().then(u => setUser(u));
  }, []);

  if (user === null) {
    return <p>Loading profile...</p>;
  }
  return (
    <>
      <h1>{user.name}</h1>
      <ProfileTimeline />
    </>
  );
}

function ProfileTimeline() {
  const [posts, setPosts] = useState(null);

  useEffect(() => {
    fetchPosts().then(p => setPosts(p));
  }, []);

  if (posts === null) {
    return <h2>Loading posts...</h2>;
  }
  return (
    <ul>
      {posts.map(post => (
        <li key={post.id}>{post.text}</li>
      ))}
    </ul>
  );
}

Approach 2: Fetch-Then-Render (not using Suspense)

// Kick off fetching as early as possible
const promise = fetchProfileData();

function ProfilePage() {
  const [user, setUser] = useState(null);
  const [posts, setPosts] = useState(null);

  useEffect(() => {
    promise.then(data => {
      setUser(data.user);
      setPosts(data.posts);
    });
  }, []);

  if (user === null) {
    return <p>Loading profile...</p>;
  }
  return (
    <>
      <h1>{user.name}</h1>
      <ProfileTimeline posts={posts} />
    </>
  );
}

// The child doesn't trigger fetching anymore
function ProfileTimeline({ posts }) {
  if (posts === null) {
    return <h2>Loading posts...</h2>;
  }
  return (
    <ul>
      {posts.map(post => (
        <li key={post.id}>{post.text}</li>
      ))}
    </ul>
  );
}

ALL >>

需求 (Feature)

介绍 (Introduce)

X

安装 (Installation)

Ubuntu 安装 xclip

OSX 安装 XQuartz

配置 (Configuration)

客户端 ssh 配置

服务端 ssh 配置

服务端 ~/.tmux.conf 配置

服务端 ~/.vimrc 配置

Trouble Shooting

vim 配置好了之后为什么不生效?

意外解决的问题

离开了上一家公司

开始接触Devops

开始完善方法论

方法

技巧

未来的计划

把自己的人生看成是 编程

几个小目标

现在需要完善的体系

人生目标

go mod

Features

Traverse

Volume

Task

Compress

Network

String

JSON

Date

Process Subsititution

Concepts and Terminology

Rules

Phases

Attributes

Private Attribute

Implementation Function

How to clone a commit from a heavy repo ?

Difference between Docker ENTRYPOINT and Kubernetes container spec COMMAND

Build Cache

Resources

我们希望将文件挂载到某个目录，但希望只是挂载该文件，不要影响挂载目录下的其他文件。有办法吗？

Data fetch ways

Approach 1: Fetch-on-Render

Approach 2: Fetch-Then-Render (not using Suspense)

`X`

Ubuntu 安装 `xclip`

OSX 安装 `XQuartz`

客户端 `ssh` 配置

服务端 `ssh` 配置

服务端 `~/.tmux.conf` 配置

服务端 `~/.vimrc` 配置

把自己的人生看成是 `编程`