Skip to content
프로젝트

thebuckleylab/jpc has 96 GitHub stars and 10 forks. GitHot measured 0 stars in 24 hours and 0 in 7 days. Last checked 2026-11-12 16:38 UTC. Last push 2026-10-21.

이 수치를 측정하는 방법

Flexible Inference for Predictive Coding Networks in JAX.

측정된 스타 증가

in 24h
0
in 7 days
0
in 15 days
업데이트 지연
in 1 month
업데이트 지연

서로 겹치는 기간의 순증가량이며 일별 합계가 아닙니다. 측정값이 없으면 비워 둡니다. 스타는 관심도를 나타내며 품질을 보장하지 않습니다.

README.md

Original

🧠 Flexible Inference for Predictive Coding Networks in JAX ⚡️

status Paper coverage

📢 Updates


JPC is a JAX library for training neural networks with Predictive Coding (PC).

JPC provides a simple, fast and flexible API for training of a variety of PCNs including discriminative, generative and hybrid models.

  • Like JAX, JPC is completely functional in design, and the core library code is <1000 lines of code.
  • Unlike existing implementations, JPC provides a wide range of optimisers, both discrete and continuous, to solve the inference dynamics of PC, including ordinary differential equation (ODE) solvers.
  • JPC also provides some analytical tools that can be used to study and potentially diagnose issues with PCNs.

If you're new to JPC, we recommend starting from the example notebooks and checking the documentation.

Overview

️💻 Installation

Clone the repo and in the project's directory run

pip install .

Requires Python 3.10+ and JAX 0.4.38–0.5.2 (inclusive). For GPU usage, upgrade jax to the appropriate cuda version (12 as an example here).

pip install --upgrade "jax[cuda12]"

📖 Documentation

Available at https://thebuckleylab.github.io/jpc/.

⚡️ Quick example

Use jpc.make_pc_step() to update the parameters of any neural network compatible with PC updates (see the notebook examples )

import jax.random as jr
import jax.numpy as jnp
import equinox as eqx
import optax
import jpc

# toy data
x = jnp.array([1., 1., 1.])
y = -x

# define model and optimiser
key = jr.PRNGKey(0)
model = jpc.make_mlp(
    key, 
    input_dim=3,
    width=50,
    depth=5,
    output_dim=3
    act_fn="relu"
)
optim = optax.adam(1e-3)
opt_state = optim.init(
    (eqx.filter(model, eqx.is_array), None)
)

# perform one training step with PC
result = jpc.make_pc_step(
    model=model,
    optim=optim,
    opt_state=opt_state,
    output=y,
    input=x
)

# updated model and optimiser
model, opt_state = result["model"], result["opt_state"]

Under the hood, jpc.make_pc_step()

  1. integrates the inference (activity) dynamics using a diffrax ODE solver, and
  2. updates model parameters at the numerical solution of the activities with a given optax optimiser.

See the documentation for more details.

NOTE: All convenience training and test functions such as make_pc_step() are already "jitted" (for optimised performance) for the user's convenience.

🚀 Advanced usage

Advanced users can access all the underlying functions of jpc.make_pc_step() as well as additional features. A custom PC training step looks like the following:

import jpc

# 1. initialise activities with a feedforward pass
activities = jpc.init_activities_with_ffwd(model=model, input=x)

# 2. perform inference (state optimisation)
activity_opt_state = activity_optim.init(activities)
for _ in range(len(model)):
    activity_update_result = jpc.update_pc_activities(
        params=(model, None),
        activities=activities,
        optim=activity_optim,
        opt_state=activity_opt_state,
        output=y,
        input=x
    )
    activities = activity_update_result["activities"]
    activity_opt_state = activity_update_result["opt_state"]

# 3. update parameters at the activities' solution with PC
result = jpc.update_params(
    params=(model, None), 
    activities=converged_activities,
    optim=optim,
    opt_state=opt_state,
    output=y, 
    input=x
)

which can be embedded in a jitted function with any other additional computations. Again, see the docs for details.

Extensions

It would be good to add tooling for:

📄 Citation

If you found this library useful in your work, please cite (paper link):

@article{innocenti2024jpc,
  title={JPC: Flexible Inference for Predictive Coding Networks in JAX},
  author={Innocenti, Francesco and Kinghorn, Paul and Yun-Farmbrough, Will and Varona, Miguel De Llanza and Singh, Ryan and Buckley, Christopher L},
  journal={arXiv preprint arXiv:2412.03676},
  year={2024}
}

Also consider starring the repo! ⭐️

🙏 Acknowledgements

We are grateful to Patrick Kidger for early advice on how to use Diffrax.

See also: other PC libraries

관련 프로젝트 살펴보기