Are we tiny?#
gptme is intended to be small and simple, and focus on doing the right thing in the right way, rather than all the things in all the ways.
The benefits of this approach are many:
It is easier to understand and maintain.
It is easier to contribute to.
It is easier to learn.
It is easier to extend.
It is more fun to work on.
Being aggressive about keeping things small and simple is a way to keep the project maintainable and fun to work on. The fastest way to kill a project is to make it too big and complex, and suffer burnout as a result.
Another major benefit of keeping things small and simple is that it makes it easier for AI to understand and work with the codebase. This is a major goal of the project, and it is important to keep in mind that the simpler the codebase is, the easier it will be for AI to work with it:
“The simpler your API is, the more effectively the AI can harness it when generating code.”
—Kenneth Reitz (and many others)
To that end, in this document we will present some statistics about the current state of the project, trying to be mindful to keep an eye on this page and make sure we are not growing too much.
Startup time#
$ make bench-importtime
...
603476 | gptme.llm
836540 | gptme.commands
841095 | gptme.chat
858940 | gptme.cli
915324 | gptme
real 0m1.838s
user 0m1.581s
sys 0m0.271s
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Lines of code#
LoC Core#
$ make cloc-core
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/*.py gptme/llm/*.py gptme/util/*.py gptme/tools/__init__.py gptme/tools/base.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.06 s (595.7 files/s, 142414.8 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_anthropic.py 91 71 413
gptme/llm/llm_openai.py 97 52 392
gptme/tools/base.py 89 77 354
gptme/util/context.py 95 136 347
gptme/logmanager.py 75 66 328
gptme/cli.py 56 52 311
gptme/config.py 93 63 295
gptme/util/prompt.py 76 98 293
gptme/chat.py 49 55 268
gptme/llm/models.py 36 17 260
gptme/message.py 60 65 241
gptme/commands.py 23 22 240
gptme/ncurses.py 39 5 238
gptme/llm/__init__.py 56 51 236
gptme/prompts.py 70 89 222
gptme/util/ask_execute.py 48 44 191
gptme/util/cli.py 51 31 174
gptme/tools/__init__.py 54 31 159
gptme/util/__init__.py 37 22 158
gptme/llm/llm_openai_models.py 2 10 138
gptme/util/export.py 17 25 86
gptme/init.py 25 19 76
gptme/util/reduce.py 24 32 75
gptme/util/generate_name.py 5 6 69
gptme/codeblock.py 13 10 64
gptme/dirs.py 27 14 55
gptme/__version__.py 9 7 45
gptme/util/cost.py 12 20 43
gptme/util/clipboard.py 8 2 35
gptme/util/terminal.py 23 21 34
gptme/wut.py 13 12 31
gptme/util/useredit.py 12 13 21
gptme/util/interrupt.py 13 14 20
gptme/constants.py 7 11 13
gptme/__init__.py 1 0 8
gptme/__main__.py 1 0 3
---------------------------------------------------------------------------------
SUM: 1407 1263 5936
---------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC LLM#
$ make cloc-llm
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/llm/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (283.4 files/s, 108951.8 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_anthropic.py 91 71 413
gptme/llm/llm_openai.py 97 52 392
gptme/llm/models.py 36 17 260
gptme/llm/__init__.py 56 51 236
gptme/llm/llm_openai_models.py 2 10 138
---------------------------------------------------------------------------------
SUM: 282 201 1439
---------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tools#
$ make cloc-tools
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/tools/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.04 s (563.0 files/s, 140191.4 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/tools/computer.py 150 218 436
gptme/tools/base.py 89 77 354
gptme/tools/tts.py 121 136 321
gptme/tools/shell.py 74 68 317
gptme/tools/tmux.py 52 72 211
gptme/tools/patch.py 44 60 195
gptme/tools/_browser_playwright.py 60 20 185
gptme/tools/python.py 56 49 172
gptme/tools/save.py 32 38 167
gptme/tools/__init__.py 54 31 159
gptme/tools/chats.py 43 49 142
gptme/tools/rag.py 63 75 141
gptme/tools/mcp_adapter.py 31 23 125
gptme/tools/subagent.py 37 29 103
gptme/tools/_browser_thread.py 20 3 97
gptme/tools/browser.py 31 63 64
gptme/tools/vision.py 19 12 53
gptme/tools/screenshot.py 14 12 44
gptme/tools/_browser_lynx.py 9 13 30
gptme/tools/youtube.py 10 1 26
gptme/tools/gh.py 14 21 16
gptme/tools/read.py 6 8 13
-------------------------------------------------------------------------------------
SUM: 1029 1078 3371
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Server#
$ make cloc-server
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/server --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (568.7 files/s, 136365.9 lines/s)
------------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------------
gptme/server/api_v2.py 187 130 547
gptme/server/static/main.js 35 45 316
gptme/server/api.py 63 53 256
gptme/server/server-api-improvements.md 40 0 202
gptme/server/static/index.html 11 15 148
gptme/server/static/style.css 27 4 143
gptme/server/static/computer.html 1 1 90
gptme/server/cli.py 9 5 58
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
------------------------------------------------------------------------------------------
SUM: 376 256 1766
------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tests#
$ make cloc-tests
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc tests --by-file
github.com/AlDanial/cloc v 1.98 T=0.04 s (1033.5 files/s, 124574.4 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
tests/test_cli.py 81 48 312
tests/test_llm_openai.py 28 0 244
tests/test_llm_anthropic.py 26 0 221
tests/conftest.py 57 31 185
tests/test_mcp.py 33 24 143
tests/test_tool_use.py 8 18 132
tests/test_prompt.py 35 36 120
tests/test_server_v2.py 37 22 118
tests/test_config.py 23 46 102
tests/test_util_cli.py 32 23 94
tests/test_tools_computer.py 36 27 91
tests/test_shell.py 27 47 82
tests/test_server.py 26 10 79
tests/test_prompt_tools.py 4 4 78
tests/test_tools.py 44 5 74
tests/test_server_v2_auto_stepping.py 16 10 73
tests/test_tools_tts.py 29 37 60
tests/test_context.py 18 13 58
tests/test_tools_patch.py 36 91 54
tests/test_server_v2_tool_confirmation.py 15 13 53
tests/test_eval.py 8 9 49
tests/test_server_v2_sse.py 15 13 49
tests/test-integration.sh 22 36 43
tests/test_message.py 7 17 39
tests/test_reduce.py 10 2 39
tests/test_codeblock.py 14 40 37
tests/test_util.py 28 51 37
tests/test_tools_rag.py 14 7 35
tests/test_chat.py 18 28 34
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
tests/test_browser.py 14 10 24
tests/test_logmanager.py 8 5 18
tests/test_prompts.py 8 2 16
tests/test_tools_chats.py 2 0 15
tests/test_tools_shell.py 9 11 13
tests/test_tools_subagent.py 7 10 11
--------------------------------------------------------------------------------------------
SUM: 822 754 2884
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Eval#
$ make cloc-eval
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/eval/**.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.01 s (597.5 files/s, 78565.7 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/eval/main.py 55 22 359
gptme/eval/run.py 48 32 279
gptme/eval/agents.py 12 5 56
gptme/eval/execenv.py 10 14 55
gptme/eval/filestore.py 5 2 32
gptme/eval/types.py 13 12 32
gptme/eval/__init__.py 1 0 4
gptme/eval/__main__.py 1 0 3
-------------------------------------------------------------------------------------
SUM: 145 87 820
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Total#
$ make cloc-total
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/prompts.py gptme/codeblock.py gptme/tools/tmux.py gptme/tools/shell.py gptme/tools/patch.py gptme/tools/youtube.py gptme/tools/base.py gptme/tools/python.py gptme/tools/rag.py gptme/tools/computer.py gptme/tools/_browser_thread.py gptme/tools/__init__.py gptme/tools/vision.py gptme/tools/mcp_adapter.py gptme/tools/save.py gptme/tools/chats.py gptme/tools/screenshot.py gptme/tools/subagent.py gptme/tools/browser.py gptme/tools/_browser_lynx.py gptme/tools/gh.py gptme/tools/read.py gptme/tools/tts.py gptme/tools/_browser_playwright.py gptme/wut.py gptme/message.py gptme/constants.py gptme/__main__.py gptme/llm/models.py gptme/llm/llm_openai.py gptme/llm/llm_anthropic.py gptme/llm/llm_openai_models.py gptme/llm/__init__.py gptme/util/reduce.py gptme/util/context.py gptme/util/interrupt.py gptme/util/cost.py gptme/util/generate_name.py gptme/util/clipboard.py gptme/util/terminal.py gptme/util/export.py gptme/util/useredit.py gptme/util/__init__.py gptme/util/cli.py gptme/util/ask_execute.py gptme/util/prompt.py gptme/init.py gptme/mcp/client.py gptme/mcp/__init__.py gptme/server/api.py gptme/server/__main__.py gptme/server/api_v2.py gptme/server/__init__.py gptme/server/cli.py gptme/config.py gptme/dirs.py gptme/__init__.py gptme/eval/main.py gptme/eval/agents.py gptme/eval/__main__.py gptme/eval/execenv.py gptme/eval/__init__.py gptme/eval/suites/init_projects.py gptme/eval/suites/basic.py gptme/eval/suites/__init__.py gptme/eval/suites/browser.py gptme/eval/run.py gptme/eval/filestore.py gptme/eval/types.py gptme/cli.py gptme/logmanager.py gptme/__version__.py gptme/chat.py gptme/ncurses.py gptme/commands.py tests/test_server_v2.py tests/test_chat_config.py tests/test_mcp.py tests/test_tools_chats.py tests/test_tools_shell.py tests/test_reduce.py tests/test_codeblock.py tests/test_eval.py tests/test_tools_subagent.py tests/test_server_v2_sse.py tests/test_browser.py tests/test_message.py tests/test_server.py tests/test_chat.py tests/conftest.py tests/test_config.py tests/test_tool_use.py tests/test_server_v2_auto_stepping.py tests/test_util_cli.py tests/test_prompts.py tests/test_tools_tts.py tests/test_llm_openai.py tests/test_logmanager.py tests/test_shell.py tests/test_prompt.py tests/test_llm_anthropic.py tests/test_tools_rag.py tests/test_tools_computer.py tests/test_cli.py tests/test_util.py tests/test_context.py tests/test_tools_patch.py tests/test_tools.py tests/test_tools_python.py tests/test_prompt_tools.py tests/test_server_v2_tool_confirmation.py scripts/describe_api.py scripts/reduce_context.py scripts/auto_rename_logs.py scripts/check_rst_formatting.py scripts/train/collect.py scripts/summarize_project.py scripts/gpt_todoer.py scripts/list_user_messages.py scripts/shorten_details.py scripts/treeofthoughts.py scripts/gh-pr-view-with-pr-comments.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.15 s (830.9 files/s, 151047.3 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
gptme/server/api_v2.py 187 130 547
gptme/tools/computer.py 150 218 436
gptme/llm/llm_anthropic.py 91 71 413
gptme/llm/llm_openai.py 97 52 392
gptme/eval/main.py 55 22 359
gptme/tools/base.py 89 77 354
gptme/util/context.py 95 136 347
gptme/logmanager.py 75 66 328
gptme/tools/tts.py 121 136 321
gptme/tools/shell.py 74 68 317
tests/test_cli.py 81 48 312
gptme/cli.py 56 52 311
scripts/gh-pr-view-with-pr-comments.py 54 36 297
gptme/config.py 93 63 295
gptme/util/prompt.py 76 98 293
gptme/eval/run.py 48 32 279
gptme/chat.py 49 55 268
gptme/llm/models.py 36 17 260
gptme/server/api.py 63 53 256
tests/test_llm_openai.py 28 0 244
gptme/message.py 60 65 241
gptme/commands.py 23 22 240
gptme/ncurses.py 39 5 238
gptme/llm/__init__.py 56 51 236
gptme/prompts.py 70 89 222
tests/test_llm_anthropic.py 26 0 221
gptme/tools/tmux.py 52 72 211
gptme/tools/patch.py 44 60 195
gptme/util/ask_execute.py 48 44 191
gptme/tools/_browser_playwright.py 60 20 185
tests/conftest.py 57 31 185
scripts/reduce_context.py 59 72 177
gptme/util/cli.py 51 31 174
gptme/tools/python.py 56 49 172
gptme/tools/save.py 32 38 167
gptme/tools/__init__.py 54 31 159
gptme/util/__init__.py 37 22 158
tests/test_mcp.py 33 24 143
gptme/tools/chats.py 43 49 142
gptme/tools/rag.py 63 75 141
gptme/llm/llm_openai_models.py 2 10 138
tests/test_tool_use.py 8 18 132
gptme/tools/mcp_adapter.py 31 23 125
tests/test_prompt.py 35 36 120
tests/test_server_v2.py 37 22 118
scripts/auto_rename_logs.py 34 18 115
scripts/gpt_todoer.py 47 25 107
gptme/tools/subagent.py 37 29 103
scripts/train/collect.py 34 52 103
tests/test_config.py 23 46 102
gptme/mcp/client.py 24 8 101
gptme/tools/_browser_thread.py 20 3 97
scripts/treeofthoughts.py 33 35 97
tests/test_util_cli.py 32 23 94
tests/test_tools_computer.py 36 27 91
scripts/check_rst_formatting.py 33 37 89
gptme/util/export.py 17 25 86
tests/test_shell.py 27 47 82
tests/test_server.py 26 10 79
tests/test_prompt_tools.py 4 4 78
gptme/init.py 25 19 76
gptme/util/reduce.py 24 32 75
tests/test_tools.py 44 5 74
tests/test_server_v2_auto_stepping.py 16 10 73
gptme/util/generate_name.py 5 6 69
gptme/codeblock.py 13 10 64
gptme/tools/browser.py 31 63 64
tests/test_tools_tts.py 29 37 60
gptme/server/cli.py 9 5 58
tests/test_context.py 18 13 58
gptme/eval/agents.py 12 5 56
gptme/dirs.py 27 14 55
gptme/eval/execenv.py 10 14 55
gptme/eval/suites/basic.py 15 1 55
gptme/eval/suites/init_projects.py 21 1 55
scripts/describe_api.py 28 25 54
tests/test_tools_patch.py 36 91 54
gptme/tools/vision.py 19 12 53
tests/test_server_v2_tool_confirmation.py 15 13 53
tests/test_eval.py 8 9 49
tests/test_server_v2_sse.py 15 13 49
gptme/__version__.py 9 7 45
gptme/tools/screenshot.py 14 12 44
gptme/util/cost.py 12 20 43
tests/test_message.py 7 17 39
tests/test_reduce.py 10 2 39
tests/test_codeblock.py 14 40 37
tests/test_util.py 28 51 37
gptme/util/clipboard.py 8 2 35
tests/test_tools_rag.py 14 7 35
gptme/util/terminal.py 23 21 34
tests/test_chat.py 18 28 34
scripts/shorten_details.py 11 6 33
gptme/eval/filestore.py 5 2 32
gptme/eval/types.py 13 12 32
scripts/list_user_messages.py 10 9 32
gptme/wut.py 13 12 31
gptme/tools/_browser_lynx.py 9 13 30
gptme/tools/youtube.py 10 1 26
scripts/summarize_project.py 11 1 26
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
tests/test_browser.py 14 10 24
gptme/util/useredit.py 12 13 21
gptme/util/interrupt.py 13 14 20
gptme/eval/suites/__init__.py 3 0 19
tests/test_logmanager.py 8 5 18
gptme/eval/suites/browser.py 5 0 16
gptme/tools/gh.py 14 21 16
tests/test_prompts.py 8 2 16
tests/test_tools_chats.py 2 0 15
gptme/constants.py 7 11 13
gptme/tools/read.py 6 8 13
tests/test_tools_shell.py 9 11 13
tests/test_tools_subagent.py 7 10 11
gptme/__init__.py 1 0 8
gptme/eval/__init__.py 1 0 4
gptme/__main__.py 1 0 3
gptme/eval/__main__.py 1 0 3
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
gptme/mcp/__init__.py 1 0 2
--------------------------------------------------------------------------------------------
SUM: 3923 3555 14700
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Code Metrics#
$ make metrics
make[2]: Entering directory '/home/runner/work/gptme/gptme'
=== Code Metrics Summary ===
Project Overview:
Files: 123
Total blocks: 892
Average complexity: 4.126681614349776
Most Complex Functions (D+):
gptme/tools/tmux.py
F 160:0 execute_tmux - D
gptme/tools/computer.py
F 433:0 computer - D
gptme/llm/llm_anthropic.py
F 165:0 stream - D
gptme/llm/__init__.py
F 109:0 _reply_stream - D
gptme/util/context.py
F 493:0 _resource_to_codeblock - D
gptme/util/ask_execute.py
F 85:0 ask_execute - D
F 187:0 execute_with_confirmation - D
gptme/eval/main.py
F 199:0 main - D
gptme/cli.py
F 139:0 main - E
gptme/chat.py
F 44:0 chat - E
F 223:0 step - D
gptme/commands.py
F 82:0 handle_cmd - E
tests/test_config.py
tests/test_server_v2_auto_stepping.py
F 15:0 test_auto_stepping - D
scripts/auto_rename_logs.py
F 31:0 auto_rename_logs - D
scripts/gh-pr-view-with-pr-comments.py
M 173:4 PRViewer.get_comments - D
Largest Files (>300 SLOC):
547 gptme/server/api_v2.py
492 gptme/tools/computer.py
413 gptme/llm/llm_anthropic.py
398 gptme/llm/llm_openai.py
369 gptme/util/context.py
361 gptme/eval/main.py
360 gptme/tools/base.py
356 gptme/tools/shell.py
331 gptme/logmanager.py
321 tests/test_cli.py
321 gptme/tools/tts.py
317 gptme/cli.py
313 gptme/util/prompt.py
Most Duplicated Files:
npm warn exec The following package was not found and will be installed: jscpd@4.0.5
Clone found (python):
- gptme/tools/tmux.py [88:8 - 100:30] (12 lines, 85 tokens)
gptme/tools/tmux.py [65:7 - 77:19]
Clone found (python):
- gptme/server/api.py [52:8 - 68:5] (16 lines, 140 tokens)
gptme/server/api_v2.py [446:16 - 463:8]
Clone found (python):
- gptme/server/api.py [98:5 - 105:8] (7 lines, 100 tokens)
gptme/server/api_v2.py [466:5 - 473:16]
Clone found (python):
- gptme/llm/llm_anthropic.py [169:5 - 183:5] (14 lines, 109 tokens)
gptme/llm/llm_anthropic.py [119:5 - 133:9]
Clone found (python):
- gptme/llm/llm_anthropic.py [183:7 - 196:3] (13 lines, 108 tokens)
gptme/llm/llm_anthropic.py [133:7 - 147:8]
Clone found (python):
- gptme/llm/llm_anthropic.py [277:2 - 317:8] (40 lines, 273 tokens)
gptme/llm/llm_openai.py [285:2 - 326:11]
Clone found (python):
- gptme/llm/llm_anthropic.py [352:4 - 370:88] (18 lines, 98 tokens)
gptme/llm/llm_openai.py [412:32 - 430:23]
Clone found (python):
- gptme/llm/llm_anthropic.py [468:1 - 487:2] (19 lines, 148 tokens)
gptme/llm/llm_openai.py [469:1 - 486:6]
┌────────────┬────────────────┬─────────────┬──────────────┬──────────────┬──────────────────┬───────────────────┐
│ Format │ Files analyzed │ Total lines │ Total tokens │ Clones found │ Duplicated lines │ Duplicated tokens │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ python │ 85 │ 17869 │ 122114 │ 8 │ 139 (0.78%) │ 1061 (0.87%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ css │ 1 │ 173 │ 1045 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ javascript │ 1 │ 395 │ 3314 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markup │ 2 │ 264 │ 2183 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markdown │ 3 │ 332 │ 2373 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ bash │ 7 │ 271 │ 1263 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ url │ 1 │ 2 │ 16 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ Total: │ 100 │ 19306 │ 132308 │ 8 │ 139 (0.72%) │ 1061 (0.8%) │
└────────────┴────────────────┴─────────────┴──────────────┴──────────────┴──────────────────┴───────────────────┘
Found 8 clones.
Detection time:: 1.507s
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
The metrics above show:
Project Overview: Basic stats about the codebase size and complexity
Complex Functions: Functions rated D+ (high complexity, should be refactored)
Large Files: Files over 300 SLOC (should be split into smaller modules)
Duplicated Files: Using jscpd to find duplicated code
We should aim to:
Keep average complexity below 4.0
Have no E-rated functions (extremely complex)
Have few D-rated functions (very complex)
Keep files under 300 SLOC where possible