{
  "_id": "6a50c73c89c83ec243a30a39",
  "Package": "Rllm",
  "Title": "Native Quantized Matrix Products and LLM Inference over\n'Rfmalloc' Tensors",
  "Version": "0.1.0",
  "Authors@R": "person(given = \"Sounkou Mahamane\", family = \"Toure\",\nemail = \"sounkoutoure@gmail.com\", role = c(\"aut\", \"cre\"))",
  "Description": "The composition layer of the 'Rfmalloc' ecosystem: it\nregisters 'Rggml' (a vendored 'GGML' build with\nruntime-SIMD-dispatched quantized kernels) as a codec-aware\nmatrix-multiply backend for 'Rfmalloc', so that products of\nfile-backed, quantized tensors run natively in quantized space\n(weights stay 'Q4_K'/'Q6_K'/... encoded, activations are\nquantized on the fly) instead of being decoded to double first.\nCombined with 'Rgguf', which exposes 'GGUF' model weights as\n'Rfmalloc'-backed tensors, this lets a larger-than-memory\nmodel's linear layers be multiplied through 'GGML's\nSIMD-accelerated dot kernels zero-copy from the memory-mapped\npayload. A transformer forward-pass graph builder over these\nprimitives is planned.",
  "License": "GPL (>= 2)",
  "Encoding": "UTF-8",
  "Remotes": [
    "sounkou-bioinfo/Rfmalloc/packages/Rfmalloc",
    "sounkou-bioinfo/Rfmalloc/packages/Rgguf",
    "sounkou-bioinfo/Rfmalloc/packages/Rggml"
  ],
  "Roxygen": "list(markdown = TRUE)",
  "RoxygenNote": "7.3.3",
  "URL": "https://github.com/sounkou-bioinfo/Rfmalloc,\nhttps://sounkou-bioinfo.github.io/Rfmalloc/Rllm/",
  "BugReports": "https://github.com/sounkou-bioinfo/Rfmalloc/issues",
  "Repository": "https://sounkou-bioinfo.r-universe.dev",
  "Date/Publication": "2026-07-10 06:12:39 UTC",
  "RemoteUrl": "https://github.com/sounkou-bioinfo/Rfmalloc",
  "RemoteRef": "HEAD",
  "RemoteSha": "921d01f6786a2db38d90a2629c39f56a244b7875",
  "RemoteSubdir": "packages/Rllm",
  "NeedsCompilation": "yes",
  "Packaged": {
    "Date": "2026-07-10 10:09:29 UTC",
    "User": "root"
  },
  "Author": "Sounkou Mahamane Toure [aut, cre]",
  "Maintainer": "Sounkou Mahamane Toure <sounkoutoure@gmail.com>",
  "_user": "sounkou-bioinfo",
  "_type": "src",
  "_file": "Rllm_0.1.0.tar.gz",
  "_fileid": "https://r2.ropensci.org/3afc8dac562d40c77b5077111a38598c3b9c8ff399757520cd684e70b804d89c",
  "_filesize": 148601,
  "_sha256": "3afc8dac562d40c77b5077111a38598c3b9c8ff399757520cd684e70b804d89c",
  "_expires": "2026-10-18T10:19:38.000Z",
  "_created": "2026-07-10T10:09:29.000Z",
  "_published": "2026-07-10T10:19:40.037Z",
  "_jobs": [
    {
      "job": 86337946028,
      "time": 120,
      "config": "linux-devel-arm64",
      "r": "4.7.0",
      "check": "OK",
      "artifact": "8224565564"
    },
    {
      "job": 86337945922,
      "time": 107,
      "config": "linux-devel-x86_64",
      "r": "4.7.0",
      "check": "OK",
      "artifact": "8224559760"
    },
    {
      "job": 86337945936,
      "time": 124,
      "config": "linux-release-arm64",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224566874"
    },
    {
      "job": 86337945964,
      "time": 99,
      "config": "linux-release-x86_64",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224556593"
    },
    {
      "job": 86337946002,
      "time": 103,
      "config": "macos-oldrel-arm64",
      "r": "4.5.3",
      "check": "NOTE",
      "artifact": "8224715259"
    },
    {
      "job": 86337945991,
      "time": 165,
      "config": "macos-oldrel-x86_64",
      "r": "4.5.3",
      "check": "NOTE",
      "artifact": "8224704294"
    },
    {
      "job": 86337945979,
      "time": 106,
      "config": "macos-release-arm64",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224640219"
    },
    {
      "job": 86337945942,
      "time": 170,
      "config": "macos-release-x86_64",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224732238"
    },
    {
      "job": 86337444970,
      "time": 166,
      "config": "source",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224516872"
    },
    {
      "job": 86337945883,
      "time": 92,
      "config": "wasm-release",
      "r": "4.6.0",
      "check": "OK",
      "artifact": "8224554004"
    },
    {
      "job": 86337945877,
      "time": 75,
      "config": "windows-devel",
      "r": "4.7.0",
      "check": "OK",
      "artifact": "8224546818"
    },
    {
      "job": 86337945954,
      "time": 74,
      "config": "windows-oldrel",
      "r": "4.5.3",
      "check": "NOTE",
      "artifact": "8224546415"
    },
    {
      "job": 86337945921,
      "time": 90,
      "config": "windows-release",
      "r": "4.6.1",
      "check": "OK",
      "artifact": "8224553740"
    }
  ],
  "_host": "GitHub-Actions",
  "_buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721",
  "_status": "success",
  "_upstream": "https://github.com/sounkou-bioinfo/Rfmalloc",
  "_commit": {
    "id": "921d01f6786a2db38d90a2629c39f56a244b7875",
    "author": "sounkou-bioinfo <sounkoutoure@gmail.com>",
    "committer": "sounkou-bioinfo <sounkoutoure@gmail.com>",
    "message": "Rggml: opt-in GGML_VK_ALLOW_128_PUSH for 128-byte-push-constant GPUs\n\nUpstream ggml refuses any Vulkan device with maxPushConstantsSize < 256 B,\nrejecting the whole device at init. In this 5D fork that 256 B is needed by\nexactly one op - the 5D non-contiguous tensor copy, already guarded at its\ndispatch in ggml-vulkan-elemwise.cpp - while vk_mat_mat_push_constants is\n68 B and every <=4D op fits in 128 B. A GPU reached only through a D3D12\ntranslation layer (Mesa dzn under WSL - the sole Vulkan path to the GPU\nthere) exposes just 128 B push constants, a D3D12 root-signature limit, so\na real GPU is rejected though it can run GEMM and all <=4D ops.\n\nGGML_VK_ALLOW_128_PUSH=1 opts in to devices with >= 128 B push constants:\nmatmul and <=4D ops run; the 5D-copy path still errors at its own dispatch.\nOff by default, so default behaviour is byte-for-byte upstream's (the error\nmessage now also points at the flag when the device has >= 128 B). Extends\nthe existing patches/ggml-vulkan_ggml-vulkan-misc.cpp.patch (regenerated;\nvendorggml.R drift guard green) exactly like the GGML_VK_ALLOW_CPU gate.\n\nVerified on an RTX 5050 via dzn (GGML_VK_DEVICE=0): flag unset -> device\nrejected with the guidance message; GGML_VK_ALLOW_128_PUSH=1 -> vulkan\nmul_mat runs, fp32-correct, 2-2.6x OpenBLAS through 4096^3 (6144^3 hits a\ndzn large-dispatch correctness cliff - a dzn limit, not this gate).\n\nShips with the public rggml_mul_mat(A, B, backend) so callers reach the\nvulkan GEMM without the RC_*_test_* symbol; RfmallocStatgen's coloc GEMM\ndispatches through it.\n",
    "time": 1783663959
  },
  "_maintainer": {
    "name": "Sounkou Mahamane Toure",
    "email": "sounkoutoure@gmail.com",
    "login": "sounkou-bioinfo",
    "mastodon": "@bioinfhotep@genomic.social",
    "description": "Sequences and Consequences.",
    "uuid": 56392505
  },
  "_distro": "resolute",
  "_registered": true,
  "_dependencies": [
    {
      "package": "R",
      "version": ">= 4.4.0",
      "role": "Depends"
    },
    {
      "package": "Rfmalloc",
      "role": "LinkingTo"
    },
    {
      "package": "Rggml",
      "role": "LinkingTo"
    },
    {
      "package": "Rfmalloc",
      "role": "Imports"
    },
    {
      "package": "Rgguf",
      "role": "Imports"
    },
    {
      "package": "Rggml",
      "role": "Imports"
    },
    {
      "package": "tinytest",
      "role": "Suggests"
    }
  ],
  "_owner": "sounkou-bioinfo",
  "_selfowned": true,
  "_usedby": 0,
  "_updates": [
    {
      "week": "2025-37",
      "n": 29
    },
    {
      "week": "2026-19",
      "n": 50
    },
    {
      "week": "2026-20",
      "n": 6
    },
    {
      "week": "2026-23",
      "n": 1
    },
    {
      "week": "2026-28",
      "n": 83
    }
  ],
  "_tags": [],
  "_topics": [
    "altrep",
    "blas",
    "genomics",
    "ggml",
    "gguf",
    "llm",
    "llm-inference",
    "malloc",
    "memory-mapped",
    "mmap",
    "out-of-core",
    "quantization",
    "simd"
  ],
  "_stars": 3,
  "_contributors": [
    {
      "user": "sounkou-bioinfo",
      "count": 191,
      "uuid": 56392505
    }
  ],
  "_userbio": {
    "uuid": 56392505,
    "type": "user",
    "name": "Sounkou Mahamane Toure",
    "followers": 48,
    "description": "Sequences and Consequences."
  },
  "_downloads": {
    "count": 0,
    "source": "https://cranlogs.r-pkg.org/downloads/total/last-month/Rllm"
  },
  "_devurl": "https://github.com/sounkou-bioinfo/rfmalloc",
  "_pkgdown": "https://sounkou-bioinfo.github.io/Rfmalloc/Rllm/",
  "_searchresults": 12,
  "_rbuild": "4.6.1",
  "_assets": [
    "extra/citation.cff",
    "extra/citation.html",
    "extra/citation.json",
    "extra/citation.txt",
    "extra/contents.json",
    "extra/NEWS.html",
    "extra/NEWS.txt",
    "extra/readme.html",
    "extra/readme.md",
    "extra/Rllm.html",
    "manual.pdf"
  ],
  "_cranurl": false,
  "_exports": [
    "rllm_backend_enabled",
    "rllm_decode",
    "rllm_encode",
    "rllm_forward",
    "rllm_generate",
    "rllm_gguf_model",
    "rllm_kv_cache",
    "rllm_quantize_tensor",
    "rllm_use_ggml"
  ],
  "_help": [
    {
      "page": "rllm_decode",
      "title": "Convert between token ids and raw bytes",
      "topics": [
        "rllm_decode",
        "rllm_encode"
      ]
    },
    {
      "page": "rllm_forward",
      "title": "Run a transformer forward pass and return the logits",
      "topics": [
        "rllm_forward"
      ]
    },
    {
      "page": "rllm_generate",
      "title": "Generate tokens with a KV cache (greedy or sampled)",
      "topics": [
        "rllm_generate"
      ]
    },
    {
      "page": "rllm_gguf_model",
      "title": "Load a llama-architecture GGUF model for forward passes",
      "topics": [
        "rllm_gguf_model"
      ]
    },
    {
      "page": "rllm_kv_cache",
      "title": "Create a KV cache for incremental decoding",
      "topics": [
        "rllm_kv_cache"
      ]
    },
    {
      "page": "rllm_quantize_tensor",
      "title": "Quantize a matrix into an Rfmalloc-backed quantized tensor",
      "topics": [
        "rllm_quantize_tensor"
      ]
    },
    {
      "page": "rllm_use_ggml",
      "title": "Enable or disable the ggml quantized matmul backend",
      "topics": [
        "rllm_backend_enabled",
        "rllm_use_ggml"
      ]
    }
  ],
  "_readme": "https://github.com/sounkou-bioinfo/Rfmalloc/raw/HEAD/packages/Rllm/README.md",
  "_rundeps": [
    "Rfmalloc",
    "Rggml",
    "Rgguf"
  ],
  "_score": 2.9542425094393248,
  "_indexed": true,
  "_nocasepkg": "rllm",
  "_universes": [
    "sounkou-bioinfo"
  ],
  "_binaries": [
    {
      "r": "4.7.0",
      "os": "linux",
      "version": "0.1.0",
      "date": "2026-07-10T10:11:39.000Z",
      "distro": "resolute",
      "arch": "aarch64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/a8faff6887190a522503cd8e029ccfe14eee430ed2898ea70622ead70d5a2e4d",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.7.0",
      "os": "linux",
      "version": "0.1.0",
      "date": "2026-07-10T10:11:21.000Z",
      "distro": "resolute",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/e04a7a5d49d2fdced90509120c9353cf8529f00164036f1fbe82dc496512ba93",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.1",
      "os": "linux",
      "version": "0.1.0",
      "date": "2026-07-10T10:11:42.000Z",
      "distro": "resolute",
      "arch": "aarch64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/7bff8a3c4382373e574e6ba97d78df8a11b89671a0d9aabed30ba9a14f65cae5",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.1",
      "os": "linux",
      "version": "0.1.0",
      "date": "2026-07-10T10:11:12.000Z",
      "distro": "resolute",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/33bf39a8dad55151add3b98e9675e8300f8155dc6b9058e5d6eef51ea5e5b64b",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.5.3",
      "os": "mac",
      "version": "0.1.0",
      "date": "2026-07-10T10:18:09.000Z",
      "arch": "aarch64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/c7d5fecc4d5a3d27d68620d934cafe117cb63f5377d9f78401b4191cc00294ce",
      "status": "success",
      "check": "NOTE",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.5.3",
      "os": "mac",
      "version": "0.1.0",
      "date": "2026-07-10T10:17:43.000Z",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/449b4b3b6eac274214f65d3835c35b408ff767fe1e8a5480dd54a7f2da9e0bdf",
      "status": "success",
      "check": "NOTE",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.1",
      "os": "mac",
      "version": "0.1.0",
      "date": "2026-07-10T10:14:40.000Z",
      "arch": "aarch64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/62aa5dff3cae637c07bb7b2a8ef5f93e786ec8a805d528029092c14480095d6f",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.1",
      "os": "mac",
      "version": "0.1.0",
      "date": "2026-07-10T10:18:55.000Z",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/c6a8c4c4624e4c398d6178357278e3d3bf96da4f55dc5c9b97b41e93f5648226",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.0",
      "os": "wasm",
      "version": "0.1.0",
      "date": "2026-07-10T10:11:15.000Z",
      "arch": "emscripten",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/d2add0492d6238f1ff2e77454f1a0d0646b4634a785ab0f6cd7270fda8d7157c",
      "status": "success",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.7.0",
      "os": "win",
      "version": "0.1.0",
      "date": "2026-07-10T10:10:34.000Z",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/a54e06a80f46c9148e5c96f0f0be17510c1c9b4927f899810b9b14f765f17091",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.5.3",
      "os": "win",
      "version": "0.1.0",
      "date": "2026-07-10T10:10:33.000Z",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/de35ad62c2a0bc85521ed053301d05fefc4b707c46c5076970e90f8392721616",
      "status": "success",
      "check": "NOTE",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    },
    {
      "r": "4.6.1",
      "os": "win",
      "version": "0.1.0",
      "date": "2026-07-10T10:10:51.000Z",
      "arch": "x86_64",
      "commit": "921d01f6786a2db38d90a2629c39f56a244b7875",
      "fileid": "https://r2.ropensci.org/6177222faad3d75f8daf342126d6ba2a41e8d423081ebc6cd50d7ed93450ac70",
      "status": "success",
      "check": "OK",
      "buildurl": "https://github.com/r-universe/sounkou-bioinfo/actions/runs/29085269721"
    }
  ]
}