[linux-aarch64, fedora 41 with luarocks 3.9.2] failure to install tree-sitter parsers #47

tombh · 2024-12-21T14:21:01Z

tombh
Dec 21, 2024

[START][2024-12-21 15:11:56] rocks.nvim logging initiated
ERROR | 2024-12-21 15:12:19 | ....local/share/nvim/rocks/rocks_rtp/lua/rocks/luarocks.lua:65 | luarocks CLI FAILED
ERROR | 2024-12-21 15:12:19 | ....local/share/nvim/rocks/rocks_rtp/lua/rocks/luarocks.lua:66 | 
Error: LuaRocks 3.11.1 bug (please report at https://github.com/luarocks/luarocks/issues).
Arch.: linux-aarch64
/home/tombh/.local/share/nvim/rocks/share/lua/5.1/luarocks/deps.lua:241: assertion failed!
stack traceback:
	[C]: in function 'assert'
	/home/tombh/.local/share/nvim/rocks/share/lua/5.1/luarocks/deps.lua:241: in function 'luarocks.deps.fulfill_dependency'
	...

ERROR | 2024-12-21 15:12:19 | ...im/rocks/rocks_rtp/lua/rocks/operations/helpers/init.lua:138 | Failed to install tree-sitter-rust

In .local/share/nvim/rocks/share/lua/5.1/luarocks/deps.lua the assert in question is by the ❌:

   local ok, install_err, errcode = install.command(install_args)
   if not ok then
      return nil, "Failed installing dependency: "..url.." - "..install_err, errcode
   end

   found, where = match_dep(dep, get_versions)
   assert(found) -- ❌
   return true, found, where

I'm not very good at debugging lua, but I think the error is when installing https://luarocks.org/luarocks-build-treesitter-parser-6.0.0-1.src.rock, but I can't find out much more than that.

This happened for Rust. But I get the same error for all languages.

Does it matter that my system lua -v is 5.4.6?

Also, if it's relevant I'm on Linux ARM.

mrcjkb · 2024-12-21T16:17:32Z

mrcjkb
Dec 21, 2024
Maintainer

hey 👋

This looks like a luarocks issue. Are you able to install any parsers using the luarocks CLI?
You can use the --tree <path> option to install into a temporary directory.

For tree-sitter parsers, the version of Lua you have installed shouldn't matter.

0 replies

tombh · 2024-12-21T23:20:00Z

tombh
Dec 21, 2024
Author

Hey! 👋

I had to install luarocks with my package manager first. But then it did install a parser fine:

Installing https://luarocks.org/tree-sitter-bash-0.0.36-1.src.rock
Missing dependencies for tree-sitter-bash 0.0.36-1:
   luarocks-build-treesitter-parser >= 5.0.0 (not installed)

tree-sitter-bash 0.0.36-1 depends on luarocks-build-treesitter-parser >= 5.0.0 (not installed)
Installing https://luarocks.org/luarocks-build-treesitter-parser-6.0.0-1.src.rock
Missing dependencies for luarocks-build-treesitter-parser 6.0.0-1:
   luafilesystem ~> 1 (not installed)

luarocks-build-treesitter-parser 6.0.0-1 depends on lua >= 5.1 (5.4-1 provided by VM)
luarocks-build-treesitter-parser 6.0.0-1 depends on luafilesystem ~> 1 (not installed)
Installing https://luarocks.org/luafilesystem-1.8.0-1.src.rock

luafilesystem 1.8.0-1 depends on lua >= 5.1 (5.4-1 provided by VM)
gcc -O2 -fPIC -I/usr/include -c src/lfs.c -o src/lfs.o
gcc  -shared -o lfs.so src/lfs.o
No existing manifest. Attempting to rebuild...
luafilesystem 1.8.0-1 is now installed in /home/tombh/.luarocks (license: MIT/X11)

luarocks-build-treesitter-parser 6.0.0-1 is now installed in /home/tombh/.luarocks (license: MIT)


tree-sitter-bash 0.0.36-1 depends on lua >= 5.1 (5.4-1 provided by VM)
tree-sitter build -o /home/tombh/.luarocks/lib/luarocks/rocks-5.4/tree-sitter-bash/0.0.36-1/lib/parser/bash.so /tmp/luarocks_tree-sitter-bash-0.0.36-1-2258713/tree-sitter-bash-49c31006d8307dcb12bc5770f35b6d5b9e2be68e
tree-sitter-bash 0.0.36-1 is now installed in /home/tombh/.luarocks (license: UNKNOWN)

That's just to see if my system is setup right? Because that doesn't seem to make the parser available in Neovim.

0 replies

mrcjkb · 2024-12-21T23:38:39Z

mrcjkb
Dec 21, 2024
Maintainer

Did you install with the --tree <path> flag?
The log looks like it's a --local install. rocks.nvim uses --tree <path>.

0 replies

tombh · 2024-12-22T11:15:04Z

tombh
Dec 22, 2024
Author

Ah yes, sorry, you did say to use --tree. Here it is again, it looks the same 🫤

$ luarocks install tree-sitter-rust --tree /tmp/treesitter
Installing https://luarocks.org/tree-sitter-rust-0.0.38-1.src.rock
Missing dependencies for tree-sitter-rust 0.0.38-1:
   luarocks-build-treesitter-parser >= 5.0.0 (not installed)

tree-sitter-rust 0.0.38-1 depends on luarocks-build-treesitter-parser >= 5.0.0 (not installed)
Installing https://luarocks.org/luarocks-build-treesitter-parser-6.0.0-1.src.rock
Missing dependencies for luarocks-build-treesitter-parser 6.0.0-1:
   luafilesystem ~> 1 (not installed)

luarocks-build-treesitter-parser 6.0.0-1 depends on lua >= 5.1 (5.4-1 provided by VM)
luarocks-build-treesitter-parser 6.0.0-1 depends on luafilesystem ~> 1 (not installed)
Installing https://luarocks.org/luafilesystem-1.8.0-1.src.rock

luafilesystem 1.8.0-1 depends on lua >= 5.1 (5.4-1 provided by VM)
gcc -O2 -fPIC -I/usr/include -c src/lfs.c -o src/lfs.o
gcc  -shared -o lfs.so src/lfs.o
No existing manifest. Attempting to rebuild...
luafilesystem 1.8.0-1 is now installed in /tmp/treesitter (license: MIT/X11)

luarocks-build-treesitter-parser 6.0.0-1 is now installed in /tmp/treesitter (license: MIT)


tree-sitter-rust 0.0.38-1 depends on lua >= 5.1 (5.4-1 provided by VM)
tree-sitter build -o /tmp/treesitter/lib/luarocks/rocks-5.4/tree-sitter-rust/0.0.38-1/lib/parser/rust.so /tmp/luarocks_tree-sitter-rust-0.0.38-1-3736374/tree-sitter-rust-1f63b33efee17e833e0ea29266dd3d713e27e321
tree-sitter-rust 0.0.38-1 is now installed in /tmp/treesitter (license: UNKNOWN)

0 replies

mrcjkb · 2024-12-22T12:45:34Z

mrcjkb
Dec 22, 2024
Maintainer

🤔 I suggest you temporarily set the vim.g.rocks_nvim._log_level option to vim.log.levels.DEBUG, to get the exact command being invoked in the log file.

It could also be that it works now that the build dependency is installed in your local ~/.luarocks tree.

0 replies

tombh · 2024-12-22T14:27:24Z

tombh
Dec 22, 2024
Author

I think I'm getting somewhere! So firstly because of a Neovim bug it's not actually possible to directly overwrite a table's field. So to change Rock's log level I did:

local tmp = vim.g.rocks_nvim
tmp._log_level = vim.log.levels.DEBUG
vim.g.rocks_nvim = tmp

Then from the logs I finally have this:

INFO | 2024-12-22 15:01:08 | ....local/share/nvim/rocks/rocks_rtp/lua/rocks/luarocks.lua:89 | { "/home/tombh/.local/share/nvim/rocks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks", "--force-lock", "--lua-version=5.1", "--tree=/home/tombh/.local/share/nvim/rocks", "--server='https://luarocks.org/manifests/neorocks/'", "--server='https://nvim-neorocks.github.io/rocks-binaries/'", "install", "--force", "tree-sitter-rust" }
ERROR | 2024-12-22 15:01:11 | ....local/share/nvim/rocks/rocks_rtp/lua/rocks/luarocks.lua:65 | luarocks CLI FAILED

Which translates into this command:

/home/tombh/.local/share/nvim/rocks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks --force-lock --lua-version=5.1 --tree=/home/tombh/.local/share/nvim/rocks --server='https://luarocks.org/manifests/neorocks/' --server='https://nvim-neorocks.github.io/rocks-binaries/' install --force tree-sitter-rust

Which returns: Error: unknown option '--force-lock'. And removing that argument allows the command to run. And now my TSInstallInfo says that the rust parser is installed. Though it still doesn't update its highlighting when opening a file until after rust-analyzer has finished. Though that's probably a different issue.

0 replies

mrcjkb · 2024-12-22T15:10:02Z

mrcjkb
Dec 22, 2024
Maintainer

Are you using luarocks version 3.11.1?

Edit: based on the path it looks like you are.
That's very strange. --force-lock is definitely supported by that version.

Could it be that you have an older luarocks version on your lua path that is somehow interfering?

Though it still doesn't update its highlighting when opening a file until after rust-analyzer has finished. Though that's probably a different issue.

You're probably not seeing tree-sitter highlighting, but LSP semantic tokens. rocks-treesitter.nvim will only start highlighting if there's a parser entry in the rocks.toml.

0 replies

tombh · 2024-12-22T19:07:48Z

tombh
Dec 22, 2024
Author

Very interesting, running this shows that even though the path implies 3.11.1, the actual luarocks version is 3.9.2!

$ /home/tombh/.local/share/nvim/rocks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks --version
/home/tombh/.local/share/nvim/rocks/bin/luarocks 3.9.2
LuaRocks main command-line interface

I even wiped my ~/.local/share/nvim path and re-installed everything from scratch and it still shows the same 3.9.2 version.

0 replies

mrcjkb · 2024-12-22T19:31:23Z

mrcjkb
Dec 22, 2024
Maintainer

It looks like your system luarocks install is doing something funky.
I'd suggest to upgrade that to version 3.11.1 and then your problem should be solved.

Hopefully soon, we will be migrating away from luarocks.

0 replies

tombh · 2024-12-22T20:04:32Z

tombh
Dec 22, 2024
Author

I wasn't aware that I'd installed luarocks. I suppose it comes with lua itself? Anyway, I'm on Fedora 41 and we only have luarocks 3.9.2 available at the moment. I have nix-env setup, so I can install the latest luarocks (and lua too), but running that previous command, I get:

$ /home/tombh/.local/share/nvim/rocks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks --version
lua: ...ks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks:4: module 'luarocks.core.cfg' not found:
        no field package.preload['luarocks.core.cfg']
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/share/lua/5.2/luarocks/core/cfg.lua'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/share/lua/5.2/luarocks/core/cfg/init.lua'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/luarocks/core/cfg.lua'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/luarocks/core/cfg/init.lua'
        no file './luarocks/core/cfg.lua'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/luarocks/core/cfg.so'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/loadall.so'
        no file './luarocks/core/cfg.so'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/luarocks.so'
        no file '/nix/store/lr85vx1ds37mvaw2s19qaf7v8jrx63cv-lua-5.2.4/lib/lua/5.2/loadall.so'
        no file './luarocks.so'
stack traceback:
        [C]: in function 'require'
        ...ks/lib/luarocks/rocks-5.1/luarocks/3.11.1-1/bin/luarocks:4: in main chunk
        [C]: in ?

Maybe I'll try manually installing it.

2 replies

mrcjkb Dec 22, 2024
Maintainer

Yes, that error message is to be expected from the CLI.
This is what's happening:

luarocks exists as a package on luarocks.org and can be installed by itself.
rocks.nvim has luarocks == 3.11.1 as a dependency (to make sure it uses the correct version).
Your system (or nix) luarocks installation installs luarocks 3.11.1, along with a bin/luarocks wrapper script,
which is prefixed with LUAROCKS_SYSCONFDIR='<path-to-system-or-nix-luarocks-installation>.
If the system/nix luarocks package is no longer available, you will run into that error.

Because of this, rocks.nvim doesn't use the bin/luarocks wrapper script. Instead, it uses the untouched wrapper script from the source, in lib/luarocks/rocks-5.1/luarocks/3.11.1/bin/luarocks.

I don't understand how your system luarocks is interfering with that though.

tombh Dec 23, 2024
Author

Thanks for the insight.

I was playing around and now the same setup that I originally started with just seems to work. And I don't know why 😬 So Fedora 41, its default luarocks package (at version 3.9.2), wiping ~/.local/share/nvim and installing everything from scratch. Treesitter installation Just Work™.

I don't know what happened. Maybe some dependency in the chain somewhere got updated?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[linux-aarch64, fedora 41 with luarocks 3.9.2] failure to install tree-sitter parsers #47

{{title}}

Replies: 10 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[linux-aarch64, fedora 41 with luarocks 3.9.2] failure to install tree-sitter parsers #47

tombh Dec 21, 2024

Replies: 10 comments · 2 replies

mrcjkb Dec 21, 2024 Maintainer

tombh Dec 21, 2024 Author

mrcjkb Dec 21, 2024 Maintainer

tombh Dec 22, 2024 Author

mrcjkb Dec 22, 2024 Maintainer

tombh Dec 22, 2024 Author

mrcjkb Dec 22, 2024 Maintainer

tombh Dec 22, 2024 Author

mrcjkb Dec 22, 2024 Maintainer

tombh Dec 22, 2024 Author

mrcjkb Dec 22, 2024 Maintainer

tombh Dec 23, 2024 Author

tombh
Dec 21, 2024

Replies: 10 comments 2 replies

mrcjkb
Dec 21, 2024
Maintainer

tombh
Dec 21, 2024
Author

mrcjkb
Dec 21, 2024
Maintainer

tombh
Dec 22, 2024
Author

mrcjkb
Dec 22, 2024
Maintainer

tombh
Dec 22, 2024
Author

mrcjkb
Dec 22, 2024
Maintainer

tombh
Dec 22, 2024
Author

mrcjkb
Dec 22, 2024
Maintainer

tombh
Dec 22, 2024
Author

mrcjkb Dec 22, 2024
Maintainer

tombh Dec 23, 2024
Author