Skip to content

Generalize make_grid_shape() to allow 1's when necessary #258

Description

@kwmsmith

Usecase: cluster running with 4 processes. User tries creating a 3D distributed array with empty((10, 20, 30), dist=('c', 'b', 'c')). Currently, this will result in a GridShapeError, since 4 has only one factoring without 1's, namely, 2 * 2. If 1's were allowed in the factoring, then this would not yield a GridShapeError, and the factoring would be (probably) (1, 2, 2). The 0th dimension would be non-distributed "cyclic", but at least it would work in many more cases than it does currently.

This would allow DistArray to always work even if the user fires up a cluster with a prime number of engines, for example. Currently, a prime number of engines will always fail for distributing over more than 1 dimension.

Activity

  1. added this to the 0.3 milestone on Mar 29, 2014
  2. modified the milestones: 0.2, 0.3 on Apr 2, 2014
  3. self-assigned this
    on Apr 2, 2014
  4. kwmsmith commented on Apr 10, 2014

    @kwmsmith
    ContributorAuthor

    Closed by #274

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions