Von Neumann architecture is based on a stored program concept where instructions and data are stored in the same memory. It uses binary arithmetic and executes instructions sequentially through the fetch–decode–execute cycle. Parallel processing is not a characteristic of the classical von Neumann model.