Numerous applied models used in the study of optimal control problems, inverse problems, shape optimization, machine learning, fractional programming, neural networks, image registration and so on lead to stochastic optimization problems in Hilbert spaces. Under a suitable convexity assumption on the objective function, a necessary and sufficient optimality condition for stochastic optimization problems is a stochastic variational inequality. This article presents a new stochastic regularized second-order iterative scheme for solving a variational inequality in a stochastic environment where the primary operator is accessed by employing sampling techniques. The proposed iterative scheme, which fits within the general framework of the stochastic approximation approach, has its almost-sure convergence analysis given in a Hilbert space. We test the feasibility and the efficacy of the proposed stochastic approximation approach for a stochastic optimal control problem and a stochastic inverse problem, both associated with a second-order stochastic partial differential equation. This article is part of the theme issue ‘Non-smooth variational problems and applications’.