Page tree
Skip to end of metadata
Go to start of metadata

Overview

Most of the finance schemas are well out of date and need to be updated.  Recent clarifications on requirements have also introduced new complexities and challenges that need to be overcome.  Given the scope of these changes and how interrelated the various schemas and APIs will be, creating a wiki page to capture this information seemed to make sense.

Schemas

Schemas exist for most of the financial records, but will need to be updated as they're out of date.  The Acquisitions Interface Fields maybe be helpful to some degree, but isn't a direct 1-to-1 mapping with the schemas due to intricacies of the data model, e.g. internal/storage use are needed which aren't captured in that spreadsheet.

Acquisition Units

The complex relationships between the various record types makes it difficult to use an inheritance pattern like we've used in other apps.  For this reason, most finance records will have an acquisitionUnits field.  How these are applied is slightly different as well.  The fiscal year detail view for instance displays ledgers, groups and funds (budgets).  In order to keep things reasonably simple, if the user has the folio permission to view the fiscal year, and belongs to one of the acquisition units assigned to the fiscal year record, the ledger, group and fund (budget) data can also be viewed.  The same concept applies across the board - e.g. ledgers detail view shows groups and funds (budgets).  We will need to get creative with our APIs and database views to make this work.

Transactions

  • Immutable
  • Payments, credits, allocations, transfers, encumbrance (see below)
  • Each of these will have their own API to allow for business logic rules, but may share a table in the storage layer.
  • Since there isn't a directly link to a budget, Querying by toFundId, fromFundId, and fiscalYearId is needed to satisfy:
    • GET transactions by Budget
  • Single transactions table, shared by multiple APIs

Schemas

transaction

PropertyTypeDefaultRequiredNotes
idstring
NUUID - System generated if not specified
amountnumber
YIdeally we could filter by a range of values; also be able to search by exact amount of transaction.

NOTE: For encumbrances: This is initialAmountEncumbered - (amountAwaitingPayment + amountExpended)
descriptionstring
N
sourcestring
YThe readable identifier of the record that resulted in the creation of this transaction
transactionTypestring
YThis describes the type of transaction
fromFundIdstring
N

UUID of the fund money is moving from

toFundIdstring
NUUID of the fund money is moving to
fiscalYearIdstring
YUUID of the fiscal year that the transaction is taking place in
sourceInvoiceIdstring
NUUID of the Invoice that triggered the creation of this transaction
sourceFiscalYearIdstring
NUUID of the fiscal year that triggered the creation of this transaction (Used during fiscal year rollover)
tagstags
N
currencystring
Ycurrency code for this transaction - from the system currency.
paymentEncumbranceIdstring
NUUID of the encumbrance associated with this payment/credit taking place.
encumbranceencumbrance
NEncumbrance sub-object - holds encumbrance-specific information not applicable to other transaction types
metadatametadata
NSystem generated metadata (createdBy/updatedBy/createdOn/etc.)

encumbrance

PropertyTypeDefaultRequiredNotes
initialAmountEncumberednumber
YShouldn't change once create
amountAwaitingPaymentnumber
N
amountExpendednumber
N
statusstring
Yenum: Released, Unreleased

APIs

Business Logic Module

MethodPathRequestResponseDescriptionNotes
POST/finance/allocationstransactiontransactionCreate an allocationcalls POST /finance-storage/transactions
POST/finance/creditstransactiontransaction

Create a credit

calls POST /finance-storage/transactions
POST/finance/paymentstransactiontransactionCreate a paymentcalls POST /finance-storage/transactions
POST/finance/transferstransactiontransactionCreate a transfercalls POST /finance-storage/transactions
POST/finance/encumbrancestransactiontransactionCreate an encumbrancecalls POST /finance-storage/transactions
GET/finance/transactions/<id>NAtransactionGet a transaction by Id
GET/finance/transactionsCQL Querytransaction_collectionSearch/List transactions
PUT/finance/encumbrance/<id>transactiontransactionUpdate an encumbranceOnly allowed if transactionType == encumbrance

NOTE:  While the various POST endpoints all talk to the same storage API, they live as separate endpoints to allow for business logic to differ between transaction types.

NOTE:  Intentionally omitted DELETE transaction endpoint here since transactions are immutable.  The storage module provides a DELETE endpoint for purposes of cleaning up API test artifacts, etc.

NOTE:  May need to add a DELETE /finance/encumbrance/<id> to support the ability to cleanup encumbrances for orders that are removed/purged.

Update: Probably not needed since this cleanup would be done by one of the business logic modules (mod-orders).  I don't think we'll need to expose this functionality directly to the user/client.

Storage Module

MethodPathRequestResponseDescriptionNotes
POST/finance-storage/transactionstransactiontransactionCreate a transactionUpdate transactions, budget(s), ledger(s) all within a DB transaction.
GET/finance-storage/transactions/<id>NAtransactionGet a transaction by Id
GET/finance-storage/transactionsCQL Querytransaction_collectionSearch/List transactions
PUT/finance-storage/transactions/<id>transactiontransactionUpdate an encumbrance

Only allowed if transactionType == encumbrance

Update transactions, budget(s), ledger(s) all within a DB transaction.

DELETE/finance-storage/transactions/<id>NA204Delete a transactionfor internal/emergency admin use only.

Encumbrance as a Transaction

  • needs to be viewed as a transaction, but can't be immutable 
  • cross (x) Option A: make encumbrance an superset of transaction, store in separate table, and use views/joins to satisfy search/filter needs.
    • Some of the field names are unintuitive - "amount" for instance is vague and potentially confusing given that we have other fields: "initalAmountEncumbered", "amountAwaitingPayment", and "amountExpended"
  •  Option B: make encumbrance a special-case of transaction.  This involves adding a bunch of optional fields to the transaction schema which would only be used for the encumbrance type of transaction.  
    • Putting these extra fields in an "encumbrance" sub-object might make sense - would allow for some schema validation to be used instead of needing to do it all in code.
    • This would allow us to store all transaction types in a single table and avoid having to deal with views/joins and confusing field names.
    • Need to implement a PUT endpoint for transactions, to support this approach, but can restrict its use (in code) to only transactions of type "encumbrance".  I don't like putting even this much business logic in the storage layer, but it's fairly limited and allows for a cleaner design.

Updating Allocated/Unavailable/Available and Other Running Totals

  • cross (x)Option A:  Have the business logic module perform calculations as money is moved
    • Harder to guarantee consistency/accuracy - is eventual consistency OK for finances?
    • Keeps business logic out of the storage module, consistent with approach taken in other acquisition apps
  • cross (x)Option B:  Perform summary/total calculations in the storage module and update all tables within a transaction.  Either they all succeed, or the entire operation fails
    • Much better control over consistency/accuracy
    • Bleeds business logic into the storage module
    • Other business logic remains in mod-finance - e.g. acquisitionUnits, what can be modified vs what can't, etc.
  • cross (x)Option C:  Calculate these numbers on-the-fly in the business logic module
    • Difficult/inefficient to do if these numbers are needed to be shown in search results (they are)
    • Likely means we'll need a more complicated data model with more views and schemas
    • Since we're calculating these numbers on the fly, consistency is less of a problem... the numbers only live in one place
  • Option D: Hybrid of B and C
    • Calculate most of these totals in the storage module and update all tables in a transaction
    • For some special cases, we need to perform calculations on the fly
      • e.g. GET groups for a ledger/FY - Only sum the amounts from the funds in those groups which are part of the ledger for this FY...

Preventing Partially Paid Invoices (WIP)

When an invoice is paid, numerous transactions (payments, credits) will be generated.  Either all or none of these need to be successfully processed; we can't have partially paid invoices.  This presents a challenge of scale.  There could feasibly be hundreds of payments for an invoice.

Option A:  Allow multiple payments to be sent at once to the payment API.

The idea here is simple... update the POST payments API to accept a collection of payments/credits and process them all at once.

Pros/Cons

  • The request payload could be quite large
  • Processing all the payments in a single call might take a prohibitively long time

Option B:  Collect/Aggregate payments/credits in the storage layer until all are received, then process together

This approach keeps the payment "simple" and consistent with the other transaction APIs.  The storage layer performs some aggregation in the database of payments/credits based on the sourceInvoiceId specified in each payment.  The flow looks something like this:

Introduce a new type of record... let's just call it a "saga" for now - what's proposed here isn't strictly a saga, but it's similar in ways.  Maybe a "paymentManifest" or something is a better name;  anyway - its not important right now.

Saga:

  • invoiceId (UUID of the invoice these payments/credits are related to)
  • numTransactions (int - total number of payments/credits)A payment or credit is posted

Flow:

  • Using the sourceInvoiceId, get the invoiceLines and sum up the total number of fundDistributions - this is numTransactions.
  • Get the saga using payments sourceInvoiceId.  If one does exist, create one.
  • Update the saga record and persist the payment record in a temporary table - do all this in a database transaction
  • If this is the last payment in the saga, (the number of entries in the temp table == numTransactions) - NOTE: we'll probably want to use a unique_index on the id field or something to ensure the same payment isn't being counted more than once.
    • Persist the payments/credits from the temporary table and perform the summary # updates (e.g. update budget, ledger, encumbrances, etc. - unavailable/available/encumbered/expended/etc.) - do this in a database transaction
      • If everything works, cleanup the temporary table and return 200 OK
      • If something fails, no actual records are updated.  The payment API call can fail and can be retried (POST payment/credit are idempotent)

NOTE:  we might be able to move some of this logic to the BL module.  The trade-off there is that the storage module would contain less logic, but would have a more complicated API.

Pros/Cons:

  • Might be able to do some incremental processing instead of having to do it all at once
  • Multiple single payments can be sent - avoids the massive request payload
  • Individual payments/credits can be repeated if needed (the POST payment API is idempotent)

Other Ideas:

  • Option B w/ optional batching... it may be convenient to allow batching (send multiple payments/credits at once); would help cut down on number of API calls needed to pay an invoice.  
    • One call per invoiceLine vs one call per fund distribution
  • TBD

Calculations

Allocations

Update Budget identified by the transactions fiscal year (fiscalYearId) and source fund (fromFundId)

  • If "fromFundId" is present,
    • allocated decreases by transaction amount
    • available decreases by transaction amount
    • unavailable increases by the transaction amount

Update Budget identified by the transaction's fiscal year (fiscalYearId) and the destination fund (toFundId)

  • allocated increases by the transaction amount
  • available increases by the transaction amount

Update Ledger identified by the transaction's fiscal year (fiscalYearId) and the source fund (fromFundId)

  • If "fromFundId" is present
    • allocated increases by transaction amount
    • available decreases by transaction amount
    • unavailable increases by the transaction amount

Update Ledger identified by the transaction's fiscal year (fiscalYearId) and the source fund (toFundId)

  • allocated increases by the transaction amount
  • available increases by the transaction amount

Transfers

Update Budget identified by the transactions fiscal year (fiscalYearId) and source fund (fromFundId)

  • If "fromFundId" is present,
    • available decreases by the transaction amount
    • unavailable increases by the transaction amount

Update Budget identified by the transactions fiscal year (fiscalYearId) and source fund (toFundId)

  • available increases by the transaction amount

Update Ledger identified by the transactions fiscal year (fiscalYearId) and source fund (fromFundId)

  • If "fromFundId" is present,
    • available decreases by the transaction amount
    • unavailable increases by the transaction amount

Update Ledger identified by the transactions fiscal year (fiscalYearId) and source fund (toFundId)

  • available increases by the transaction amount

Payments (WIP)

Update Budget identified by the transaction's fiscal year (fiscalYearId) and the source fund (fromFundId)

  • available decreases by transaction amount
  • unavailable increases by transaction amount

Update Ledger identified by the transaction's fiscal year (fiscalYearId) and the source fund (fromFundId)

  • available decreases by transaction amount
  • unavailable increases by transaction amount

Credits (WIP)

Update Budget identified by the transaction's fiscal year (fiscalYearId) and the source fund (toFundId)

  • available increases by transaction amount
  • unavailable decreases by transaction amount

Update Ledger identified by the transaction's fiscal year (fiscalYearId) and the source fund (toFundId)

  • available increases by transaction amount
  • unavailable decreases by transaction amount

Encumbrances

FundTypes

  • Simple controlled vocabulary

Schemas

fund_type

PropertyTypeDefaultRequiredNotes
idstring
NoUUID - System generated if not specified

name

string
Yes

APIs

Business Logic Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance/fund-typesfund_typefund_typeCreate a fund-typefinance.fund-types
GET/finance/fund-types/<id>NAfund_typeGET fund-type by Idfinance.fund-types
GET/finance/fund-typesCQL Querycollection<fund_type>Search/List fund-typesfinance.fund-types
PUT/finance/fund-types/<id>fund_typefund_typeUpdate a fund-typefinance.fund-types
DELETE/finance/fund-types/<id>NA204Delete a fund-typefinance.fund-types

Storage Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance-storage/fund-typesfund_typefund_typeCreate a fund-typefinance-storage.fund-types
GET/finance-storage/fund-types/<id>NAfund_typeGET fund-type by Idfinance-storage.fund-types
GET/finance-storage/fund-typesCQL Querycollection<fund_type>Search/List fund-typesfinance-storage.fund-types
PUT/finance-storage/fund-types/<id>fund_typefund_typeUpdate a fund-typefinance-storage.fund-types
DELETE/finance-storage/fund-types/<id>NA204Delete a fund-typefinance-storage.fund-types

Funds

  • Record with info that doesn't change from FY to FY (name, code, acq. units, etc.)

Schemas

fund

PropertyTypeDefaultRequiredNotes
idstring
NoUUID - System generated if not specified

name

string
Yese.g. African History
codestring
YesUnique.  e.g. AFRICAHIST
fundStatusstring
Yesenum - Active, Inactive, Frozen
fundTypeIdstring
NoA descripter that allows the users to categorize funds and drive functionality in workflows like rollover etc. controlled vocab.
externalAccountstring

No

Corresponding account in the financial system. Will be recorded in payment generated as well.
descriptionstring
No
allocatedFromIdsarray<string>
NoUUIDs of funds money can be allocated from
allocatedToIdsarray<string>
NoUUIDs of funds money can be allocated to
tagstags
No
ledgerIdstring
YesUUID of the ledger this fund belongs to
acqUnitIdsarray<string>
NoArray of UUIDs corresponding to the acquisition units assigned to this fund.
metadatametadata
NoSystem generated metadata (createdBy/updatedBy/createdOn/etc.)

APIs

Business Logic Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance/fundsfundfundCreate a fundfinance.funds
GET/finance/funds/<id>NAfundGET fund by Idfinance.funds
GET/finance/fundsCQL Querycollection<fund>Search/List fundsfinance.funds
PUT/finance/funds/<id>fundfundUpdate a fundfinance.funds
DELETE/finance/funds/<id>NA204Delete a fundfinance.funds

Storage Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance-storage/fundsfundfundCreate a fundfinance-storage.funds
GET/finance-storage/funds/<id>NAfundGET fund by Idfinance-storage.funds
GET/finance-storage/fundsCQL Querycollection<fund>Search/List fundsfinance-storage.funds
PUT/finance-storage/funds/<id>fundfundUpdate a fundfinance-storage.funds
DELETE/finance-storage/funds/<id>NA204Delete a fundfinance-storage.funds

Groups

  • Record with info that doesn't change from FY to FY
  • A Group/Fund/FY table will be needed to track fund/group relationships on a per FY basis.

Schemas

group

PropertyTypeDefaultRequiredNotes
idstring
NUUID - System generated if not specified
namestring
YUnique
descriptionstring
N
codestring
YUnique
statusstring
Yenum: Active, Inactive, Frozen
acqUnitIdsarray<string>
NArray of UUIDs corresponding to the acquisition units assigned to this group.  
metadatametadata
NSystem generated metadata (createdBy/updatedBy/createdOn/etc.

groupFundFY

PropertyTypeDefaultRequiredNotes
idstring
NUUID - System generated if not specified
groupIdstring
YUUID of group
fiscalYearIdstring
YUUID of fiscal year
fundIdstring
YUUID of fund

allocated

number
Nnot persisted
unavailablenumber
Nnot persisted
availablenumber
Nnot persisted

APIs

Business Logic Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance/groupsgroupgroupCreate a groupfinance.groups
GET/finance/groups/<id>NAgroupGET groupby Idfinance.groups
GET/finance/groupsCQL Querycollection<group>Search/List groupsfinance.groups
PUT/finance/groups/<id>groupgroupUpdate a groupfinance.groups
DELETE/finance/groups/<id>NA204Delete a groupfinance.groups
GET/finance/groups/<id>/budgets

CQL Query,

Fiscal Year Query (req)

collection<budget>List budgets in this groupfinance.groups

Queries view API: Group + Budget + Fund/Group/FY (by groupId, fiscalYearId, group.acqUnits)

  • returns array of budget

Enforces acquisition units based on group's assignments, ignores budget/fund acq. units.

The fiscalYear query arg is the UUID of a fiscal-year record

Storage Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance-storage/groupsgroupgroupCreate a groupfinance-storage.groups
GET/finance-storage/groups/<id>NAgroupGET group by Idfinance-storage.groups
GET/finance-storage/groupsCQL Querycollection<group>Search/List groupsfinance-storage.groups
PUT/finance-storage/groups/<id>groupgroupUpdate a groupfinance-storage.groups
DELETE/finance-storage/groups/<id>NA204Delete a groupfinance-storage.groups

Ledgers

  • Record with info that doesn't change from FY to FY
  • Ledger/FY table will be needed to track per FY information (e.g. summary #s)

Schemas

ledger

PropertyTypeDefaultRequiredNotes
idstring
NUUID - system generated if not specified
namestring
YUnique
descriptionstring
N
codestring
YUnique
ledgerStatusstring
Yenum: Active, Inactive, Frozen

allocated

number
Nnot persisted
unavailablenumber
Nnot persisted
availablenumber
Nnot persisted
currencystring
Ncurrency code 
acqUnitIdsarray<string>
NArray of UUIDs corresponding to the acquisition units assigned to this ledger.
metadatametadata
NSystem generated metadata (createdBy/updatedBy/createdOn/etc.)

ledgerFY

PropertyTypeDefaultRequiredUpdated On TransactionNotes
idstring
N

N

UUID - system generated if not specified
ledgerIdstring
YNUUID of ledger
fiscalYearIdstring
YNUUID of fiscal year

allocated

number
NY
unavailablenumber
NY
availablenumber
NY
currencystring
YNcurrency code for this fiscal year 

APIs

Business Logic Module

Method

Path

Request

Response

Description

Interface

Notes

POST/finance/ledgersledgerledgerCreate a ledgerfinance.ledgers
GET/finance/ledgers/<id>Fiscal Year Query (opt)ledgerGET ledger by Idfinance.ledgers

If FY specified:Queries GET /finance-storage/ledger-fiscal-year

  • Return Ledger w/ summary #s
  • Enforces acquisition units based on ledger's assignments, ignores budget's acq. units.

else

  • return ledger w/o summary #s

The fiscalYear query arg is the UUID of a fiscal-year record

GET/finance/ledgers

CQL Query

Fiscal Year Query (opt)

collection<ledger>Search/List ledgersfinance.ledgers

If FY specified:

  • Queries GET /finance-storage/ledger-fiscal-year
  • Return Ledgers w/ summary #s
  • Enforces acquisition units based on ledger's assignments, ignores budget's acq. units.

else

  • return ledger w/o summary #s

The fiscalYear query arg is the UUID of a fiscal-year record

PUT/finance/ledgers/<id>ledgerledgerUpdate a ledgerfinance.ledgers
DELETE/finance/ledgers/<id>NA204Delete a ledgerfinance.ledgers
GET/finance/ledgers/<id>/budgets

CQL Query,

Fiscal Year Query (req)

collection<budget>Get budgets for a ledgerfinance.ledgers

Queries GET /finance-storage/group-fund-fiscal-years (by fiscalYear, ledger, ledger.acqUnits)

Enforces acquisition units based on ledger's assignments, ignores budget's acq. units.

The fiscalYear query arg is the UUID of a fiscal-year record

GET/finance/ledgers/<id>/groups

CQL Query,

Fiscal Year Query (req)

collection<group_fund_fy>Get groups for a ledgerfinance.ledgers

Queries GET /finance-storage/group-fund-fiscal-years (by ledgerId, fiscalYearId, ledger.acqUnits)

  • pages all results or gets them all in one go
  • sums #s for each group
  • returns array of group_fund_fy

Enforces acquisition units based on ledger's assignments, ignores group's acq. units.

Does not support paging

The fiscalYear query arg is the UUID of a fiscal-year record

Storage Module

Method

Path

Request

Response

Description

Interface

Notes

POST/finance-storage/ledgersledgerledgerCreate a ledgerfinance-storage.ledgers
GET/finance-storage/ledgers/<id>NAledgerGET ledgerby Idfinance-storage.ledgers
GET/finance-storage/ledgersCQL Querycollection<ledger>Search/List ledgersfinance-storage.ledgers
PUT/finance-storage/ledgers/<id>ledgerledgerUpdate a ledgerfinance-storage.ledgers
DELETE/finance-storage/ledgers/<id>NA204Delete a ledgerfinance-storage.ledgers

Budgets

  • Essentially a Fund/FY object

Schemas

budget

PropertyTypeDefaultRequiredUpdated On TransactionNotes
idstring
NNUUID - system generated if not specified
namestring
YN= <fund.code>-<fiscal_year.code>, eg. AFRICAHIST-FY19.  Unique
budgetStatusstring
YNenum: Active, Frozen, Planned, Closed
allowableEncumbrancenumber
NN
allowableExpenditurenumber
NN
allocatednumber
YYRunning total of all the allocation transactions against the budget.
awaitingPaymentnumber
NY (encumbrance only)Running total of all the invoiced amounts (i.e. waiting to be paid)
availablenumber
NY = allocation - awaiting_payment - encumbered - expenditures
encumberednumber
NY (encumbrance only)Running total of money set aside for purchases
expendituresnumber
NY (encumbrance only)Running total of all the payments recorded by the fund
unavailablenumber
NYTBD
overEncumbrancenumber
NY (encumbrance only)Amount the budget is over encumbered. Is this needed?
overExpendednumber
NY (encumbrance only)Amount the budget is over expended. Is this needed?
fundIdstring
YNUUID of fund
fiscalYearIdstring
YNUUID of fiscal year
acquisitionUnitsarray<string>
NNArray of UUIDs corresponding to the acquisition units assigned to this budget.
tagstags
NNinherited from fund
metadatametadata
NYSystem generated metadata (createdBy/updatedBy/createdOn/etc.)

APIs

Business Logic Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance/budgetsbudgetbudgetCreate a budgetfinance.budgets
GET/finance/budgets/<id>NAbudgetGET budget by Idfinance.budgets
GET/finance/budgetsCQL Querycollection<budget>Search/List budgetsfinance.budgets
PUT/finance/budgets/<id>budgetbudgetUpdate a budgetfinance.budgets
DELETE/finance/budgets/<id>NA204Delete a budgetfinance.budgets

Storage Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance-storage/budgetsbudgetbudgetCreate a budgetfinance-storage.budgets
GET/finance-storage/budgets/<id>NAbudgetGET budget by Idfinance-storage.budgets
GET/finance-storage/budgetsCQL Querycollection<budget>Search/List budgetsfinance-storage.budgets
PUT/finance-storage/budgets/<id>budgetbudgetUpdate a budgetfinance-storage.budgets
DELETE/finance-storage/budgets/<id>NA204Delete a budgetfinance-storage.budgets

Fiscal Years

Schemas

fiscal_year

PropertyTypeDefaultRequiredNotes
idstring
NUUID - system generated if not specified
namestring
Ye.g. Texas Fiscal Year
codestring
YUnique e.g FY19
descriptionstring
N
periodStartdate
Y
periodEnddate
Y
currencystring
NCurrency code used (recorded when the FY ends, otherwise the system currency can be assumed)
acqUnitIdsarray<string>
NArray of UUIDs corresponding to the acquisition units assigned to this fiscal year.
metadatametadata
NSystem generated metadata (createdBy/updatedBy/createdOn/etc.)

APIs

Business Logic Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance/fiscal-yearsfiscal_yearfiscal_yearCreate a fiscalYearfinance.fiscal-yearsMay result in creation of other records
GET/finance/fiscal-years/<id>NAfiscal_yearGet fiscalYear by Idfinance.fiscal-years
GET/finance/fiscal-yearsCQL Querycollection<fiscal_year>Search/List fiscalYearsfinance.fiscal-years
PUT/finance/fiscal-years/<id>fiscal_yearfiscal_yearUpdate a fiscalYearfinance.fiscal-years
DELETE/finance/fiscal-years/<id>NA204Delete a fiscalYearfinance.fiscal-years
GET/finance/fiscal-years/<id>/ledgersCQL Querycollection<ledgerFY>Get ledgers for a fiscalYearfinance.fiscal-years

Queries GET /finance-storage/ledger-fiscal-year (on fiscalYear.id and fiscalYear.acqUnits)

Enforces acquisition units based on fiscalYear's assignments, ignores ledger's acq. units.

GET/finance/fiscal-years/<id>/groupsCQL Querycollection<group_fund_fy>Get groups for a fiscalYearfinance.fiscal-years

Queries GET /finance-storage/group-fund-fiscal-years (on fiscalYear.id and fiscalYear.acqUnits)

Iterates over results and calculates summary #s

Enforces acquisition units based on fiscalYear's assignments, ignores group's acq. units.

Does not support paging

GET/finance/fiscal-years/<id>/budgetsCQL Querycollection<budget>Get budgets for a fiscalYearfinance.fiscal-years

Queries GET /finance-storage/ledger-budgets (on budget.fiscalYearId and fiscalYear.acqUnits)

Enforces acquisition units based on fiscalYear's assignments, ignores budget's acq. units.

Storage Module

MethodPathRequestResponseDescriptionInterfaceNotes
POST/finance-storage/fiscal-yearsfiscal_yearfiscal_yearCreate a fiscalYearfinance-storage.fiscal-years
GET/finance-storage/fiscal-years/<id>NAfiscal_yearGET fiscalYear by Idfinance-storage.fiscal-years
GET/finance-storage/fiscal-yearsCQL Querycollection<fiscal_year>Search/List fiscalYearsfinance-storage.fiscal-years
PUT/finance-storage/fiscal-years/<id>fiscal_yearfiscal_yearUpdate a fiscalYearfinance-storage.fiscal-years
DELETE/finance-storage/fiscal-years/<id>NA204Delete a fiscalYearfinance-storage.fiscal-years

Database Views

Several views are needed to accommodate some of the inter-record queries.  These have been mentioned throughout the document.  This section pulls that info into a single place and adds additional details (e.g. related API definitions)

N.B. This was written prior to  RMB-395 - Getting issue details... STATUS .  These views are no longer needed in light of this new cross-index subquery functionality.  I'm leaving this section as-is in case this approach does not prove adequate for our needs.

LedgerFY

  • join: ledgerFY + ledger + fiscalYear
    • ledger.id == ledgerFY.ledgerId
    • fiscalYear.id == ledgerFY.fiscalYearId
  • jsonb:  ledger_fy
  • NOTE: we need fiscalYear here because when calling this from GET /finance/fiscal-years/<id>/ledgers we need to query against the fiscalYear's acquisition units.

API

MethodPathRequestResponseDescriptionInterfaceNotes
GET/finance-storage/ledger-fiscal-yearsCQL Querycollection<ledger_fy>Search/list ledger/FYfinance-storage.ledgersNeeded for Fiscal Year details view, ledger accordion

GroupFundFY

  • joins: Fund + Budget + Fund/Group/FY + Ledger + FIscalYear
    • fund.id == FundGroupFY.fundId.
    • budget.fiscalYearId == FundGroupFY.fiscalYearId AND budget.fundId = FundGroupFY.fundId
    • ledger.id == fund.ledgerId
    • fiscalYear.id == budget.fiscalYearId
  • jsonb: group_fund_fy
  • NOTE: we need ledger here because when calling this from GET /finance/ledgers/<id>/groups we need to query against the ledger's acquisition units.
  • NOTE: we need fiscalYear here because when calling this from GET /finance/fiscal-years/<id>/groups we need to query against the FY's acquisition units.

API

MethodPathRequestResponseDescriptionInterfaceNotes
GET/finance-storage/group-fund-fiscal-yearsCQL Querycollection<group_fund_fy>Query group/fund/FY viewfinance-storage.groupsNeeded for Ledger and Fiscal Year details views, groups accordion

LedgerBudget

  • joins: Fund + Budget + Ledger + FiscalYear
    • fund.id == budget.fundId.
    • ledger.id == fund.ledgerId
    • fiscalYear.id == budget.fiscalYearId
  • jsonb: budget
  • NOTE: we need ledger here because when calling this from GET /finance/ledgers/<id>/budgets we need to query against the ledger's acquisition units.
  • NOTE: we need fiscalYear here because when calling this from GET /finance/fiscal-years/<id>/budgets we need to query against the fiscalYear's acquisition units.

API

MethodPathRequestResponseDescriptionInterfaceNotes
GET/finance-storage/ledger-budgetsCQL Querycollection<budget>Query ledger/budget viewfinance-storage.budgetsNeeded for Ledger and Fiscal Year details views, funds accordion

End-to-End Flow

  1. Setup - Create and link financial structures
    • Fiscal Year(s) are created
      • a ledgerFY with new FY is created for each ledger??  Only if not in the past?
      • a budget with new FY is created for each fund??  Only if not in the past?
      • a groupFundFY with new FY is created for each fund/group pair??  Only if not in the past?
    • Ledgers are created
      • a ledgerFY is created for each FY??  Only if not in the past?
    • Funds are created
    • Budgets are created
    • Groups are created
    • Funds are added to groups
      • a groupFundFY is created for each fund/group/FY tuple??  Only if FY not in the past?
  2. Money is allocated to budgets
    • Allocations (transactions) are created
    • Budgets are updated
      • budget.allocated increases
      • budget.available/unavailable are re-calculated
    • Ledgers are updated
      • ledger.allocated/available/unavailable are re-calculated
  3. An order is created and opened
    • Encumbrances are created for each of the POL's fund distributions
      • Need to check if the budget.allocated >= amount being encumbered
      • Need to check if the budget.allowableEncumbered >= (budget.encumbered + amount being encumbered)
    • Budgets are updated
      • budget.encumbered increases
      • budget.available/unavailable are re-calculated
    • Ledgers are updated
      • ledger.allocated/available/unavailable are re-calculated
  4. An invoice is created and approved
    • Voucher is generated
    • Encumbrances are updated
      • transaction.encumbrance.amountAwaitingPayment increases
      • transaction.amount (effective encumbered amount is recalculated
    • Budgets are updated
      • budget.encumbered → budget.awaitingPayment
      • budget.available/unavailable are re-calculated
    • Ledgers are updated
      • ledger.allocated/available/unavailable are re-calculated
  5. Invoice is paid
    • Voucher is marked as paid
    • Payments (transactions) are created
    • Encumbrances are updated
      • transaction.encumbrance.amountAwaitingPayment → transaction.encumbrance.amountExpended
      • transaction.amount (effective encumbered amount is recalculated
    • Budgets are updated
      • budget.awaitingPayment → budget.expenditures
      • budget.available/unavailable are re-calculated
    • Ledgers are updated
      • ledger.allocated/available/unavailable are re-calculated
    • Orders/POLs are updated
      • purchaseOrder.paymentStatus = partially/fullyPaid
      • poLine.paymentStatus = partially/fullyPaid
    • For each order, If fully paid
      • repeat 4, 5 as needed
    • Else 
      • Encumbrances are released
        • transaction.amount (effective encumbered amount is recalculated (becomes 0)
      • Budgets are updated
        • budget.encumbered decreases
        • budget.available/unavailable are re-calculated
      • Ledgers are updated
        • ledger.allocated/available/unavailable are re-calculated
      • Order is closed
  6. Fiscal Year ends/starts
    1. TBD

JIRA

Convenient place to put links to features/stories in JIRA

  • TBD

Mockups

https://drive.google.com/drive/folders/1Vc401TCsooCeUWNwBQForjYpADE7CMW8

Open Issues/Other Considerations

  • The set of columns to show in search results has not been reviewed by the small group yet.  That could potentially affect this if there are changes.
  • How to express allocateTo/allocateFrom "all" funds?  none?  groups?
    • It was discussed that we might at some point add separate fields for specifying groups of funds that a fund can allocatedTo/From.  At the moment this is the best idea we've come up with.  One potential downside is that it might encourage proliferation of groups which will have a negative impact on performance in the current design due to needing to perform group calculations on the fly.
  • How to capture changes in currency?  Historically?  
    • No need to track the currency code in each fund, but when the fiscalYear ends, we should capture the system currency in use at the time.
    • Displaying search results with different currencies.... e.g. FY18 is in USD, FY19 is in CAD - Is this possible?  Something like:
      • Discussed with the FE guys, and this shouldn't be a problem. 

Appendix

Required Queries (WIP)

View Budget Transactions

In order to support searching for transactions for a given budget:  https://drive.google.com/open?id=1w-kNrURaAQ0cjiHl0NzADaLnackJN0mT

  1. GET transactions by Budget, search/filter on:
    1. transactionType
    2. source
    3. fromFundId
    4. toFundId
    5. status
    6. tags
    7. date (range)
    8. fiscalYearId
    9. description
    10. amount

View Budget Details

In order to support Budget details view: https://drive.google.com/open?id=1ezTFSS6Rypv_wg8eVBoMbsLRoci-2UR-

  1. GET Budget by Id - including allocated/avail/unavail summary
  2. GET FY by Id

View Group Details

In order to support Group details view: https://drive.google.com/open?id=1qxEIiISiNX6wSTQUEbTwfcx-fwL8xwbv

  1. GET Group by Id - including allocated/avail/unavail summary
  2. GET Funds by Group/FY - including allocated/avail/unavail 

View Fund Details

In order to support Fund details view:  https://drive.google.com/open?id=1ksgVbdEc426JCMkUDuey_GlB-M9c3to_

  1. GET Fund by Id
  2. GET Budget by FY (current FY - Equals, previous FYs - LessThan, next FY - GreaterThan)

View Ledger Details

In order to support Ledger details view:  https://drive.google.com/open?id=1MMQdlKU1-OFlpCDCClHQMvTi-xPTf2K

  1. GET funds for ledger/FY - including allocated/avail/unavail
  2. GET groups for ledger/FY - including allocated/avail/unavail
  3. GET FYs for a ledger
  4. GET funds for a group
  5. GET ledger for FY - including allocated/avail/unavail summary



  • No labels
Write a comment…