Split a large JSON file into multiple files

example.json

[
{"one":"two"},
{"three":"four"}
]

split.rb

source_file = 'example.json'
line_number = 0
page_size = 25_000

def write(file_name, data)
  File.write(file_name, data, mode: 'a')
end

File.readlines(source_file).each do |line|
  page = line_number / page_size
  file_name = "data/#{page.abs}.json"
  write(file_name, "[\n") if !line_number.zero? && (line_number % page_size).zero?
  if ((line_number + 1) % page_size).zero?
    write(file_name, line.chomp(",\n"))
    write(file_name, "\n]") unless line.end_with?("]\n")
    puts "Finished file #{page + 1}"
  else
    write(file_name, line)
  end
  line_number += 1
end

it's work with nested json files?

This only works with flat arrays.