How to

13 DDPG

Initializing search

How to

how-to

Home
>>> This is a template
GitHub
GitHub
- 在 ios 上使用 2-factor authentication
- 学生怎样申请 Copilot 可以提高成功率
- Github Desktop 快速提交修改
- kex_exchange_identification: Connection closed by remote host
- Multi user
- Ssh t git github com failed
- Unsubscribe discussions notifications
- When remote branch renamed
- FoundationPose
  FoundationPose
  - 日志 wsl2
- Real stanford
  Real stanford
  - Cloth funnels
    Cloth funnels
    
    No rule to make target NvFlexReleaseCUDA x64.a
    
    Cmake no pybind11 config cmake
    
    No gl h
Frames
Frames
- Ros
  Ros
  - Basic
  - Clean dead nodes or topics
  - Azure
    Azure
    
    Ubuntu ros1 azure
  - Rviz
    Rviz
    
    Cant open could not contact ros master at
    
    rviz::RenderSystem: error creating render window: OGRE EXCEPTION(3:RenderingAPIException)
  - Urdf
    Urdf
    
    View urdf
- Ros2
  Ros2
  - Best practice for ros2 cpp dependencies
  - Ros2 搭建与 foxglove 的桥梁
  - Runtime error
    Runtime error
    
    Could not load library dlopen error: /home/julyfun/ros_ws/install/tf_test/lib/libtf_test.so: undefined symbol
- Vite
  Vite
  - Could not auto determine entry point from rollupoptions
Hardwares
Hardwares
- Hikvision
- Arduino
  Arduino
  - Macos link and upload code
- Intel
  Intel
  - 型号意思
Langs
Langs
- Bench which language is faster website
- Algo
  Algo
  - Tarjan
  - 笛卡尔树上 lca 为区间最值的说明
- Assembly
  Assembly
  - One command to see assembly of c code
- C
  C
- Cmake
  Cmake
- Cpp
  Cpp
  - Std
    Std
    
    upper_bound and lower_bound
- Latex
  Latex
- Make
  Make
  - Make uninstall failed
- Markdown
  Markdown
  - Hide elements
- Mutual
  Mutual
  - C++ to Python
- Python
  Python
  - Ast tuple
  - Collections also counter
  - Create dict in for loop
  - Define a scope anywhere in python
  - Dict map
  - Explicit dict type
  - Get cur dir
  - Get uppercase letter
  - Import path rules
  - Internal if or if you wanna call it filter
  - libGL error MESA LOADER failed to open iris usr lib dri iris dri so
  - Networkx
  - Print all stuffs in a module
  - Pybullet
  - Random
  - Zip
  - Base and builtin
    Base and builtin
    
    Print list without brackets python
    
    Sort
  - Collections
    Collections
    
    deque
  - Conda
    Conda
    
    Base operation
    
    Do not activate base
    
    Free disk
    
    Remove env
    
    Show env size
    
    Use pip
  - Input
    Input
    
    Read multiple numbers in one line
  - Ipynb
    Ipynb
    
    Export to pdf
  - Matplotlib
    Matplotlib
    
    Draw axis with exp or semilogy
    
    Plot 3d
    
    Save img in plt
    
    Save nparray img
    
    Show img
  - Multiprocessing
    Multiprocessing
    
    Runtime error attemp to start a new process before the current process
  - Numpy
    Numpy
    
    Convert inner type in array
  - Opencv
    Opencv
    
    Typeerror numpy. dtypemeta object is not subscriptable when import cv2
  - Pandas
    Pandas
    
    Csv
  - Pip
    Pip
    
    Don t use cache
    
    List packages
    
    Proxy error when install
    
    Show installed
    
    Show package version
    
    Install
    Install
    
    Use tsinghua mirror
  - Pytorch
    Pytorch
    
    Can t download previous old version
    
    Nn module train or eval
    
    Resize img smoothly
  - Requests
    Requests
    
    Ssl error
  - Sympy
    Sympy
    
    Matrix inverse print
  - Taichi
    Taichi
    
    Allocate function error
    
    Build legacy branch
    
    Draw plane
    
    Struct for cannot be nested inside a kernel
    
    Unknown error while init
  - Tutorials
    Tutorials
    
    File read write
    
    Func set dict sort
- Ranking
  Ranking
  - Github contributions langs ranking
  - How often a lang tutorials are searched on google
- Regex
  Regex
  - Any character
  - Patterns
- Rust
  Rust
  - Async await
  - Default parameters
  - Functional programming
  - Install rust
  - Print type
  - Rc
  - Reduce exe size
  - Ref cell
  - Why do some trait implementations receive values, while others take references?
  - Cargo
    Cargo
    
    Blocking waiting for file lock on the registry index
    
    Cargo.old
    
    Compile into bin and change the binary name
    
    Cache
    Cache
    
    Clear repo cache
    
    Install
    Install
    
    Attempted ssh agent authentication
    
    Net
    Net
    
    SSL connect error
    
    Publish
    Publish
    
    Checking before publishing
  - Examples
    Examples
    
    Run examples
    
    Thread spawn
  - Package
    Package
    
    Classic structure
    
    How to publish a package on crates.io correctly?
  - Rust analyzer
    Rust analyzer
    
    Omg rust analyzer not working in repo with build rs
  - Rustup
    Rustup
    
    error: could not rename component file from
  - Test
    Test
    
    How do I write a Rust unit test that ensures that a panic has occurred?
    
    Test a specific file or specific test
- Typst
  Typst
Learn
Learn
- Csapp
- D2l
  D2l
  - Linear
- Economy
  Economy
  - Link
- Games 103
  Games 103
  - Links
- Math
  Math
  - Analysis
    Analysis
    
    Fatou
  - Calculus
    Calculus
    
    Nju pdf
  - Matrix
    Matrix
    
    Spd 正定矩阵
    
    正交矩阵和酉矩阵
    
    矩阵标量向量相互求导
Life
Life
- Connect minipc
- Two factor authenticator from mobile to mac
- 这是 test
- Diy pc
  Diy pc
  - 不插显卡可以进 BIOS 插显卡则黑屏.1
- Image
  Image
  - Jpeg to uint8 mat
- Sjtu
  Sjtu
  - Js 半自动评教
  - 生存手册
- Sjtu rm
  Sjtu rm
  - Deploy rm cv std on robot
- Usaco
  Usaco
  - Python example
- Video clip
  Video clip
Mirrors
Mirrors
- Github
- Pip
  Pip
  - Tsinghua
- Rust
  Rust
  - rsproxy-sparse
Network
Network
Notes
Notes
- Julyfun
  Julyfun
  - 摸鱼日志
  - ROADMAP
  - Paper reading
  - 24
    24
    
    07
    07
    
    how-to 服务器维护日志
    
    Moveit2 错误修复日志
    
    光速搭建带有图床的博客
    
    08
    08
    
    comptime? runtime? launchtime!
    
    不同文档博客的标记语法
    
    为何不应该透露家里的难事
    
    引号的滥用
    
    文章天成，妙手偶得
    
    神秘的3天旅行包
    
    神秘的软件小包
    
    第一性原理之为什么 Latex 比富文本更容易编辑和阅读
    
    编码器和执行器科普
    
    09
    09
    
    Test
    
    装机日志
    
    10
    10
    
    感官区分
  - 个人配置
    个人配置
    
    Msys2
  - 关注
    关注
    
    Typst touying
    
    Typst
    
    Zed
  - 大四上
    大四上
    
    机器学习
    机器学习
    
    RF and Boosting
    
    K means n hac n dbscan
    
    欧洲经济学
    欧洲经济学
    
    单一市场
    
    计算机体系结构
    计算机体系结构
    
    0 汇编相关
    
    1 指令集计算
    
    3 内存布局
  - 工作
    工作
    
    Jfmfoi
    Jfmfoi
    
    24.08.17
    24.08.17
    
    Jfmfoi
    
    William
    William
    
    Note
    
    240914
    240914
    
    教学计划差分与离散化
    
    240921
    240921
    
    教学计划找规律
    
    240929
    240929
    
    教学计划找规律II
    
    课堂要点
    
    241013
    241013
    
    课堂计划
    
    241020
    241020
    
    课堂计划
    
    241102
    241102
    
    课堂小结
    
    课堂计划
    
    241109
    241109
    
    课堂小结
    
    课堂计划
    
    241116
    241116
    
    课堂计划
  - 工具
    工具
    
    Typst
    
    Remote
    Remote
    
    Rustdesk
  - 技术学习
    技术学习
    
    Acm
    Acm
    
    失误日志
    
    D2l
    D2l
    
    0.0 基础
    
    10.1.queries keys values
    
    10.2.注意力汇聚
    
    10.3.注意力评分函数
    
    3.0.1.损失函数
    
    3.0.激活函数
    
    3.2.linear regression scratch
    
    3.4.softmax
    
    4.2.mlp
    
    4.3.mlp concise
    
    4.5.weight decay
    
    4.5.权重衰减
    
    4.6.dropout
    
    5.2.参数管理
    
    6.0.卷积基础
    
    7.1.alexnet
    
    7.2.vgg
    
    7.3.nin
    
    7.4.googlenet
    
    7.5.BN
    
    7.6.resnet
    
    7.7.densenet
    
    8.1.sequence
    
    8.3.语言模型和数据集
    
    8.4.RNN
    
    8.5.rnn scratch
    
    8.6.rnn concise
    
    8.7.bptt
    
    9.1.gru
    
    9.3.deep rnn
    
    9.4.bi rnn
    
    9.5.dataset
    
    9.6.encoderdecoder
    
    9.7.seq2seq
    
    9.8.beam search
    
    快速配置 d2l
    
    词汇表
    
    问题
    
    Hrl
    Hrl
    
    1 概述
    
    10 actor critic算法
    
    11 trpo算法
    
    12 PPO
    
    13 DDPG
    
    14 SAC
    
    15 模仿学习
    
    2 多臂老虎机
    
    3 马尔科夫决策过程
    
    4 动态规划算法
    
    5 时序差分算法
    
    6 Dyna Q 算法
    
    7 DQN
    
    8 DQN 改进算法
    
    9 策略梯度算法
    
    Oi
    Oi
    
    证明基础
    
    信号处理
    信号处理
    
    零极点滤波器设计大纲
    
    机械臂
    机械臂
    
    DH 描述
    
    计网
    计网
    
    1 概述
    
    2 物理层
    
    3 数据链路层
    
    4 网络层
    
    5 传输层
    
    6 应用层
  - 数学基础
    数学基础
    
    傅里叶变换
    
    常见导数
    
    常见积分
    
    微分方程
    
    微积分
    
    梯度，散度，旋度，Laplace, nabla
    
    分布
    
    理解 SE3 变换矩阵
    
    积分技巧
    
    数分
    数分
    
    Hessian 矩阵
    
    泰勒公式余项估计
    
    数论
    数论
    
    中国剩余定理
    
    物理基础
    物理基础
    
    力矩和转动
    
    符号与字母表
    符号与字母表
    
    希腊字母
    
    数学符号速查
  - 生活
    生活
    
    PLEASE ASK
    
    宿舍用品分类
    
    宿舍用品归位
    
    随身携带小包
Os
Os
- Ios
  Ios
  - Network error except for weixin
- Macos
  Macos
  - Better top
  - Check charging power
  - Cli restart without restarting all apps.1
  - Connect xbox controller
  - Harmless useful extensions
  - Hide title bar.no sol
  - Mouse touchpad scroll direction
  - Scan qrcode
  - Third party keyboard disable capslock
  - Typing french
  - Why storage always changing.1
  - 无法验证开发者
  - 软件已损坏，无法打开
  - Activity monitor
    Activity monitor
    
    Applications storage extensions
  - Brew
    Brew
    
    Brew update failed because cant fetch github
    
    Clean cache
    
    Install brew
  - Cli
    Cli
    
    Eof is ctrl d
    
    Lscpu
    
    Show battery
    
    Show free memory
    
    Show mem and swap
    
    Top
  - Devices
    Devices
    
    Add printer
  - Disk
    Disk
    
    Clean disk
  - Drivers
    Drivers
    
    Ch340g ch34g ch34x mac os x driver
  - Finder
    Finder
    
    Close all terminal windows
    
    Keyboard shortcuts
  - Iterm2
    Iterm2
    
    Hide title bar
  - Menu bar
    Menu bar
    
    How to display CPU/GPU usage in top menu bar (right side)?
  - Network
    Network
    
    SSH Link Another Machine like Ubuntu
  - Service
    Service
    
    Create a quick action to open folder in terminal
  - Shortcuts
    Shortcuts
    
    Full screen and cancel
    
    Lock screen
    
    监测 shortcuts 被谁使用
  - Softwares
    Softwares
    
    Floating on top clock
    
    Show input method when switching
    
    Show key pressed
    
    Smaller screen recorder
- Ubuntu
  Ubuntu
  - 16 04 sources
  - Apt
  - Change font not working especially in vscode
  - Disable capslock
  - Dpkg uninstall packages
  - How to disable the window not responding dialog
  - Install configure uninstall ubuntu
  - Install deb
  - Multi screen
  - Quick suspend
  - Show installed packges
  - Show ubuntu version
  - Tsinghua source
  - Bluetooth
    Bluetooth
    
    Bluetooth open but cant find device
  - Disk
    Disk
    
    Visualizer baobab
  - Input source
    Input source
    
    Install ibus pinyin on Ubuntu20.04
    
    输入法用着用着没了
  - Key
    Key
    
    Disbale ctrl+shift+e
  - Locale font
    Locale font
    
    Can't display Chinese
  - Network
    Network
    
    Cli (nmcli) connect wifi
    
    Restart network
  - Service
    Service
    
    Start service at boot
  - Time
    Time
    
    Multi machine time syncrhonize
  - User
    User
    
    Add new sudo user
- Windows
  Windows
  - Rdp connection to windows
  - Setup ssh server on win
  - Strong uninstaller geek uninstaller
  - Cant boot
    Cant boot
    
    Cant boot after installing nvidia driver
  - Hardwares
    Hardwares
    
    无线网卡无法检测到部分网络或输入密码后无法连接
  - Keyboard
    Keyboard
    
    Disbale capslock on win10
  - Msys2
    Msys2
    
    Setup msys2 like unix fish
  - Ping
    Ping
    
    Ping windows
  - Wsl
    Wsl
    
    Connect usb
    
    Install wsl and use cmake in vscode
    
    Permission denied when using docker from wsl
    
    Switch default user
    
    Gui
    Gui
    
    Gui 问题 libxcb 无法启动 xclock
    
    Nvidia
    Nvidia
    
    Devices i processes j gpu memory percentage 100
    
    Nvidia smi missing after installling cuda
    
    Vscode
    Vscode
    
    Vscode cannot connect to remote Linux （_WebSocket close with status code 1006)
Softwares and tools
Softwares and tools
- Harmless useful tools
- Konsole
- Online softwares
- Use gdb
- Apt
  Apt
  - Show apt installed packages
- Bashtop
  Bashtop
  - Install
- Chrome
  Chrome
  - Recommended extensions
    Recommended extensions
    
    Julyfun
- Clang
  Clang
  - Export clang s json from make
- Clash
  Clash
  - Edit connection rule
  - Use clash on remote linux, using pure cli
- Clash for windows
  Clash for windows
  - Backpack
- Cli tools
  Cli tools
  - Proxychains
  - Zip
    Zip
    
    Compress a folder
- Cloc
  Cloc
  - Ignore .gitignore files
- Docker
  Docker
- Fish
  Fish
  - Array and for
  - Batch rename file extension in a for loop
  - Env param too many duplicates
  - Newline slash n in string
  - Numbers calculations
  - Private functions
  - Show exec time after executing command
  - Switch font color
  - >>> This is a template
  - Ternary operator
  - Tide config
  - Unset variables
  - Builtin
    Builtin
    
    list all builtins
  - String
    String
    
    Get string length
    
    String empty or unset
    
    String join in non empty
    
    String regex get variable
    
    String sub
  - Test
    Test
    
    Test n and z
- Gcc
  Gcc
  - Debug option
- Git
  Git
  - Aliyun git commit message
  - Another git process seems to be running in this repository
  - Change default branch for everything i do
  - Curl 92 http 2 stream 0 was not closed cleanly
  - Delete all previously tracked but should be ignored files
  - Git export
  - Git status 显示中文乱码
  - Git.old
  - Show git sha
  - You have not concluded your merge merge head exists
  - 从历史中删除大文件
  - Add
    Add
    
    Revert git add
  - Branch
    Branch
    
    Delete a remote branch
    
    Fix when remote default branch is renamed
    
    Get current branch name
    
    Git branch
  - Clone
    Clone
    
    Clone certain branch
    
    Clone certain version
    
    Git shallow clone local repo
  - Commit
    Commit
    
    Revert last commit
    
    没有检出一个提交
  - Config
    Config
    
    Show config
    
    Where is git config file
  - Conflict
    Conflict
    
    choose Conflicts in rebase
  - Diff
    Diff
    
    Diff staged or unstaged
    
    Diff vs status
    
    How to compare a local git branch with its remote branch
  - Init
    Init
    
    Convert a existing non empty directory to git
  - Lfs
    Lfs
    
    error: external filter 'git-lfs filter-process' failed
  - Log
    Log
    
    Git log command search content
    
    Git log oneline date author
    
    Git log show commit details
  - Pull
    Pull
    
    Git pull local and remote conflict
    
    Need to specify how to reconcile divergent branches when git pull
  - Remote
    Remote
    
    Create new branch in remote
  - Reset
    Reset
    
    Revert last commit
  - Restore
    Restore
    
    Discard changes or restore a file
    
    Restore cur dir
  - Stage
    Stage
    
    Show stages
  - Submodule
    Submodule
    
    Add exisiting local git repo as submodule as a submodule to parent directory repo?
    
    Clone or update submodule
    
    Shallow clone
    
    Update all submodules to latest commit
  - Tag
    Tag
    
    Create a tag in a github repository
    
    Rename tag
    
    Tag
  - Workflow
    Workflow
    
    Workflow by Gao Tian
- Ide
  Ide
  - Android studio
    Android studio
    
    Export apk
- Mysql
  Mysql
  - Start on macos
- Neovim
  Neovim
  - E303 Unable to open swap file
  - Default init vim
  - Delete between underscores
  - Jump to next python func
  - Nvim and packer old
  - Nvim buf set name
  - Quick line jumps
  - Waka time where to enter api key
  - Packer
    Packer
    
    Download failed
    
    Packer always say error running config
  - Vim plug
    Vim plug
    
    Deal with vim plug download failure
    
    Use vim plug
- Nginx
  Nginx
  - Subdomain
- Node
  Node
  - Npm install hangs on sill idealtree build
- Npm
  Npm
  - Npm ps1，因为在此系统上禁止运行脚本
- Ntp
  Ntp
  - ntp synchronize time
- Nvidia
  Nvidia
  - Cuda errors
  - Install multiple cuda versions and switch between them
  - Nvcc shows wrong version
  - Nvidia docker on ubuntu 16 04
  - Nvidia driver.1
  - Old nvidia smi or called driver
  - Record nvidia smi fix 230918
  - Show how many gpu you have
  - Watch nvidia gpu in real time
  - Install
    Install
    
    Install nvidia-smi and cuda from zero
    
    on ubuntu
    
    Windows
    Windows
    
    install nvidia-driver
- Obs
  Obs
  - Crop the recording area
- Obsidian
  Obsidian
  - Resize image
- Postgresql
  Postgresql
  - Start on mac vscode
- Recommendations
  Recommendations
  - I want to draw geometry pics with letters and marks online
- Shells
  Shells
  - Change default shell
  - Displays icons error
  - Powershell
    Powershell
    
    Common commands
- Slack
  Slack
  - 安卓手机通知
- Sogou pinyin
  Sogou pinyin
  - Install on ubuntu20.04
  - 拼音模式下居然在拼英文是什么情况
- Ssh
  Ssh
  - Copy remote multiple files
  - Failed to connect any ssh host
  - Ssh copy id
  - Ssh.old
  - To mac
    To mac
    
    ssh mac from win
- Sublime
  Sublime
  - Close all without confirmation
  - Load init vim
- Unity
  Unity
- Unix cli
  Unix cli
  - Awk
  - Background run
  - Better top
  - Change newline style dos unix lf crlf
  - Cli wifi
  - Count lines in directory
  - Curl
  - Extract nth line of an output
  - File size
  - Get file s path and file name
  - Grep
  - Only stderr output to less
  - Print all env parameter
  - Really clear screen
  - Scp
  - See if i am sudoer
  - Show process mem
  - Show shell
  - Sort based on directories size
  - Switch user
  - Unexport
  - Ln
    Ln
    
    How to list symbolic link chains?
  - Ls
    Ls
    
    get the most recent file in directory shell
  - String
    String
    
    Filter lines starting with k4a
    
    Filter out those containing a specfig pattern
  - Tar
    Tar
    
    Unzip tar file
    
    Unzip xz file
  - Tmux
    Tmux
    
    Enable mouse
    
    how to set up config.fish to auto run tmux every time start fish
- Vim cheatsheat
  Vim cheatsheat
- Vim tutorial
  Vim tutorial
  - 简易 vim 教程
- Vmware
  Vmware
  - Cant uninstall on win11
- Vscode
  Vscode
  - Choose a python virtual environment
  - Different tab sizes depending on the language file im programming in vs code
  - Disable a extension in workspace
  - Error loading webview: Error: Could not register service workers: TypeError: Failed to register a ServiceWorker for scope
  - Extension list
  - Format python.1
  - Install on ubuntu
  - Show file git changes
  - Clangd
    Clangd
    
    Cant find bits std c h on macos
    
    Cant find std header file like algorithm
    
    Strange recovery methods
    
    Install
    Install
    
    To install
  - Debug
    Debug
    
    C cmake debug
    
    C cpp direct file debug
    
    Python
    Python
    
    Python debug
    
    Set the working directory
  - Extensions
    Extensions
    
    Neovim
    Neovim
    
    Deal with E79 at start and buftype error at save
    
    Dont show output message
    
    Failed to start nvim nvim_execute_lua
  - Jupyter
    Jupyter
    
    Show line number
  - Linux
    Linux
    
    Linux vscode 无法输入中文
    
    固定 ip
  - Python
    Python
    
    Pylance cant find some modules
    
    Pylance not working at all
  - Remote ssh
    Remote ssh
    
    Remote ssh failed
  - Setup
    Setup
    
    Setup basic things like devcpp
  - Ui
    Ui
    
    Adjust rulers
    
    Auto fold line word wrap
    
    Developer tool webview
    
    Do not show reference count before items
    
    UI-components names
    
    What are those ui components and bars called
  - Windows
    Windows
    
    Setup clangd, cmake just like on unix
- Zed
  Zed
  - Setup conda virtual env
- Zerotier
  Zerotier
  - Build your zerotier lan for mac win and wsl and android
Website
Website
- Valine blog comment
- 申请 SSL 证书
- Huggingface
  Huggingface
  - Download
    Download
    
    Set mirror
- Zhihu
  Zhihu
  - click all invite

13 DDPG

直接输出确定性策略，不是输出概率.
[undone]

Made with Material for MkDocs