Hot Topics in 30 days range - c#

I have over 10k topics in my DB table, and I count page views for each topic on session base and store only one view/per topic/per user (session time 24 hrs).
ID-----Topic----------------Views
1------Love------------------400
2------Friends---------------203
3------Birthday--------------360
Now I want to get hot topics in last 30 days, means I want to get hot topics on bases of page views in last 30 days. I just need a little direction, on how I can achieve this. Thanks

You will need to separate into a Topic table and a TopicView table if you want to truly adapt to recent views. With the current table structure there is no idea of how recent a view is - so if you have a topic spike big-time in week 10 of the year, it may remain #1 on your hot topic list for a very long time (as 'Views' column is cumulative over all-time).
CREATE TABLE Topic (
[Id] INT NOT NULL IDENTITY(1,1)
[Topic] VARCHAR(255) NOT NULL
)
CREATE TABLE TopicView (
[ViewId] INT NOT NULL IDENTITY(1,1),
[TopicId] INT NOT NULL,
[User] VARCHAR(255) NOT NULL,
[ViewDate] DATETIME NOT NULL
)
Now you can check every time a user hits a page if you have already logged a 'TopicView' for them. When you want to see what topics are hot, you could execute:
DECLARE #maxResults INT = 100 --the maximum number of results we will show
DECLARE #hotTopicViewDays INT = 30 --how recent we want to see hot topic activity
DECLARE #hotTopicViewLimit INT = 300 --what amount of views we consider hot
SELECT TOP (#maxResults)
T.[Id],
T.[Topic],
COUNT(TV.[ViewID]) [Views]
FROM [Topic] T
JOIN [TopicView] TV
ON T.[Id] = TV.[TopicId]
WHERE TV.ViewDate >= DATEADD(DAY, -(#hotTopicViewDays), GETDATE())
GROUP BY T.[Id],
T.[Topic]
HAVING COUNT(TV.[ViewId]) >= #hotTopicViewLimit
This is pretty extensible and will allow you to configure:
How many results you want to return with #maxResults
How recent views need to be to factor into "hot topic" activity with #hotTopicViewDays
How much activity is required to consider a topic "hot" with #hotTopicViewLimit
Let me know if there are any questions or if anyone sees an issue with this approach.

You already store the views in the database, which is good. You'll also need to have stored the date on which the topic was created.
Provided you have done that, you can write a query like this one (I dunno your column names etc.):
SELECT *
FROM Topics t
WHERE t.DateAdded >= dateadd(day, -30, getdate())
ORDER BY t.Views DESC
It returns all topics created in the last 30 days, most viewed topics first.
You do not want to load all ten thousand records into memory so, make sure you implement pagination.

Related

How to write stored procedures for JSON Web API data

I haven't written a stored procedure as yet. I have just deserialised some JSON data from a Web API feed. I've got some console writelines to confirm the data is being deserialised, but need to replace them with writing stored procedures for each piece of data which can then be called from the DB in a view later on.
I've looked up writing stored procedures in VS but none look like they would work in this way. I'm assuming that within the foreach I need to execute a SqlParameter of some kind to write the data attribute from the JSON to the DB table and respective column. Just a little stuck on where to start.
My program to fetch data from the API looks like this.
private static async void UpdateStreetWebApiProperties()
{
var client = new HttpClient();
var request = new HttpRequestMessage
{
Method = HttpMethod.Get,
RequestUri = new Uri("https://inventorymanchester.co.uk/api/property-feed/sales/search"),
Headers =
{
{ "ContentType", "application/json" },
{ "Authorization", "Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJhdWQiOiIxIiwianRpIjoiNzU5YTJlZjZmYjY0MWE3NjRiZGE5ZjdmYzk2ZDNkMjAwN2IwNTk1MTMyZWJlYjhjMmQ0MTUyZDZlODcwZGI4ODRiOTFmMWEzMGE5NDA0ZWEiLCJpYXQiOjE2NTU3MzQzNjAuNDA5OTY1LCJuYmYiOjE2NTU3MzQzNjAuNDA5OTcxLCJleHAiOjE5NzEzNTM1NjAuMTE2MzYzLCJzdWIiOiIxMzM0MjIiLCJzY29wZXMiOlsicHVibGljLWFwaSJdfQ.kxo8GVwKFRUgfyhrRqUrh6bQvJvv5PfJgken90RulA_hTKuX4zWPs6fZ6RkljSK1ECsPYfeNKF5Z_E-xYekRWtDKOcWCXp-wKKNfHWA7rwVU1NzzeghszqcQ0ojLqcqiJ_sxFXCyouvP6LW1-jlcWmYUaHrBu2rajSSyo-K3RN_uFq85Fc5_XkCAvTzO4U59ZcNU4nhRvj3SG2b4l0kZPGlTePkJafciToZ-Q618DYDtO1Q63hUY6X6CunjIIKXiw8h1o9qG9vlmV60JBuVZ4COzc05H-e4UrA3tYkxa6O6xi3baczCZFr97bTIwXMRlifUh8E6WS29T_2uIjSl5OIcaXLuDhrxYOUrfTsFuGU2SuwKKflps0jAUir1s_T_Fi4sPiC5BqvvbrPSBHXlNQpguIN6nYCK4FXW2ixALjs5e2JKN5gMmOCFeqzEmZJAkrHR0iN7n-UbWwsX7dh8ODss3XprckzadC-f_EHiY4ZDSdKPPnJTukkA0V-ezafoO-hBPeiiPOo-IH3kqCyElUMv2sosV4yaFT8DhFlrivCAktwXz4vkKTUYhjuueWU-QxX1y2MwE0zT32SKb21Bwp4Z7nJ0Fa84_CglbWWZZVglJh6Rrgmmg17DgxpSJx3qCiqqum3UrKGTYuLTube47zjumFQeyy1cYUWmqcRG84OQ" },
},
};
using (var response = await client.SendAsync(request))
{
response.EnsureSuccessStatusCode();
if (response.IsSuccessStatusCode)
{
var properties = await response.Content.ReadAsStringAsync();
string strBufJSON = properties;
// above is web service results
JsonModel.JSONModel.Rootobject jData;
jData = JsonConvert.DeserializeObject<JsonModel.JSONModel.Rootobject>(strBufJSON);
foreach (var data in jData.data)
{
// now display some values
Console.WriteLine(data.attributes.public_url);
Console.WriteLine(data.attributes.inline_address);
Console.WriteLine(data.attributes.sale_status);
Console.WriteLine(data.attributes.bathrooms);
}
}
else
{
Console.WriteLine("Could not get properties");
}
}
}
I have outlined my table like this and matched my JSON data attributes to match the table columns in a hope it makes it easier. I'm running SQL Server 2014.
USE [TortoiseDB]
GO
/****** Object: Table [dbo].[Tortoise_Street_Properties]
Script Date: 07/26/2022 11:54:22 ******/
SET ANSI_NULLS ON
GO
SET QUOTED_IDENTIFIER ON
GO
SET ANSI_PADDING ON
GO
CREATE TABLE [dbo].[Tortoise_Street_Properties](
[id] [int] IDENTITY(1,1) NOT NULL,
[Pid] [varchar](255) NULL,
[inlineaddress] [varchar](255) NULL,
[postcode] [varchar](20) NULL,
[description] [varchar](255) NULL,
[bedrooms] [varchar](255) NULL,
[price] [varchar](255) NULL,
[salestatus] [varchar](255) NULL,
[brochure] [varchar](255) NULL,
[longitude] [int] NULL,
[latitude] [int] NULL,
[virtualtour] [varchar](255) NULL,
PRIMARY KEY CLUSTERED
(
[id] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF,
IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
GO
SET ANSI_PADDING OFF
GO
The JSON looks like the following also to add context:
{"data":[{"type":"property","id":"a91ab45e-5db8-4486-9bdf-f38dcb63c400","attributes":{"branch_uuid":"3e7a4a68-ab41-46c3-9a48-e3d1635cd056","inline_address":"101 London Road, Peterborough","public_address":"London Road, Peterborough, PE2","postcode":"PE2 9DD","bedrooms":5,"bathrooms":2,"receptions":2,"floor_area":null,"plot_area":null,"land_area":null,"property_type":"Detached House","property_age_bracket":null,"construction_year":null,"status":"For Sale","sale_status":"For Sale","lettings_status":null,"owner_label":"Vendor","tenure":null,"tenure_notes":null,"lease_expiry_year":null,"lease_expiry_date":null,"public_url":"https:\/\/inventorymanchester.co.uk\/platform\/properties\/a91ab45e-5db8-4486-9bdf-f38dcb63c400","created_at":"2022-06-17T15:18:53+01:00","updated_at":"2022-07-12T11:23:11+01:00","custom_meta_data":[],"property_urls":[],"viewing_booking_url":"https:\/\/inventorymanchester.co.uk\/platform\/properties\/a91ab45e-5db8-4486-9bdf-f38dcb63c400\/book-viewing"},"relationships":{"address":{"data":{"type":"address","id":"433518e4-d544-42ce-aba4-7d1137465af1"}},"details":{"data":{"type":"details","id":"1bf2b0fc-36c1-40f1-9e04-5b5cf72ffd0c"}},"salesListing":{"data":{"type":"sales_listing","id":"992114a6-3fcf-48b1-af1d-f5f3976a23da"}},"lettingsListing":{"data":null},"primaryImage":{"data":{"type":"media","id":"9ed40865-0873-4159-808b-5941faa520c9"}}}},{"type":"property","id":"4fd57964-71ea-4a77-b773-b4079a0f95dc","attributes":{"branch_uuid":"3e7a4a68-ab41-46c3-9a48-e3d1635cd056","inline_address":"4 Riverside Mead, Peterborough","public_address":"Riverside Mead, Peterborough, PE2","postcode":"PE2 8JN","bedrooms":4,"bathrooms":3,"receptions":2,"floor_area":null,"plot_area":null,"land_area":null,"property_type":"Detached House","property_age_bracket":null,"construction_year":null,"status":"Sold STC","sale_status":"Sold STC","lettings_status":null,"owner_label":"Vendor","tenure":null,"tenure_notes":null,"lease_expiry_year":null,"lease_expiry_date":null,"public_url":"https:\/\/inventorymanchester.co.uk\/platform\/properties\/4fd57964-71ea-4a77-b773-b4079a0f95dc","created_at":"2022-06-17T16:39:19+01:00","updated_at":"2022-07-19T11:39:26+01:00","custom_meta_data":[],"property_urls":[],"viewing_booking_url":"https:\/\/inventorymanchester.co.uk\/platform\/properties\/4fd57964-71ea-4a77-b773-b4079a0f95dc\/book-viewing"},"relationships":{"address":{"data":{"type":"address","id":"03d1a68a-6f4a-42ff-bf65-5b9768d6ce81"}},"details":{"data":{"type":"details","id":"f2b1a173-0611-4014-a980-894257b0bab0"}},"salesListing":{"data":{"type":"sales_listing","id":"be1cec3a-cf2f-40c4-a627-427cf3fbdfa7"}},"lettingsListing":{"data":null},"primaryImage":{"data":{"type":"media","id":"125542ce-27f1-4852-8fb6-b71daaaa70d1"}}}}],"included":[{"type":"address","id":"433518e4-d544-42ce-aba4-7d1137465af1","attributes":{"anon_address":"London Road, Peterborough, PE2","line_1":"101 London Road","line_2":"Peterborough","line_3":null,"town":"Peterborough","postcode":"PE2 9DD","inline":"101 London Road, Peterborough, PE2 9DD","longitude":-0.2465764,"latitude":52.560172}},{"type":"details","id":"1bf2b0fc-36c1-40f1-9e04-5b5cf72ffd0c","attributes":{"display_property_style":null,"work_required":null,"heating_system":null,"council_tax_band":null,"council_tax_cost":null,"local_authority":null,"service_charge":null,"service_charge_period":"month","service_charge_notes":null,"ground_rent":null,"ground_rent_period":"month","ground_rent_review_period_years":null,"ground_rent_uplift":null,"ground_rent_expiry":null,"full_description":"<p>Tortoise Property are pleased to offer this five bed detached house that is situated in the popular location of London Road, Fletton.<br><br>**Please call for either a viewing or virtual tour of this property.**<br><br>The property has a hallway, ground floor bathroom, bedroom, kitchen, dining room, lounge and converted garage on the ground floor. There are four bedrooms and the family bathroom on the first floor.<br><br>Outside the property has a front garden, a back garden and off-road parking for four cars.<br><\/p>","short_description":null,"location_summary":"London Road is a great location that is situated within walking distance of the city centre and local amenities. The Queensgate shopping centre is an 16 minute walk. The train station is a 21 minute walk or 5 minutes by car. The Kings secondary school is a 6 minute drive.\r\n\r\nPeterborough City Centre can be reached by car in 5 minutes and by bus in 10 minutes.\r\n\r\nThe A1 Junction can be reached by car in 11 minutes and the surrounding parkways give access to the A47 both east and west. \r\n\r\nWe love Fletton because of the lifestyle you can enjoy here. Great homes, close to nature and superb facilities make this one of our favourite places to live and work.","has_parking":null,"has_outdoor_space":null,"virtual_tour":null,"shared_ownership":false,"shared_ownership_notes":null,"shared_ownership_rent":null,"shared_ownership_rent_frequency":null,"shared_ownership_percentage_sold":null,"created_at":"2022-06-17T15:18:54+01:00","updated_at":"2022-06-17T15:28:08+01:00"}},{"type":"sales_listing","id":"992114a6-3fcf-48b1-af1d-f5f3976a23da","attributes":{"status":"For Sale","price":300000,"price_qualifier":"In Excess of","display_price":true,"archived":false,"is_low_profile":false,"occupancy_status":1,"new_home":false,"created_at":"2022-06-17T15:29:16+01:00","updated_at":"2022-06-17T15:29:57+01:00"}},{"type":"media","id":"9ed40865-0873-4159-808b-5941faa520c9","attributes":{"name":"136511_31517777_IMG_17_0000","order":0,"is_featured":true,"feature_index":1,"title":null,"is_image":true,"url":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg","urls":{"thumbnail":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg?tr=pr-true,n-property_thumb","small":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg?tr=pr-true,n-property_small_fill_crop","medium":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg?tr=pr-true,n-property_medium_fill_crop","large":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg?tr=pr-true,n-property_large_fill_crop","hero":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg?tr=pr-true,n-property_hero","full":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844548\/136511_31517777_IMG_17_0000.jpeg"}}},{"type":"address","id":"03d1a68a-6f4a-42ff-bf65-5b9768d6ce81","attributes":{"anon_address":"Riverside Mead, Peterborough, PE2","line_1":"4 Riverside Mead","line_2":"Peterborough","line_3":null,"town":"Peterborough","postcode":"PE2 8JN","inline":"4 Riverside Mead, Peterborough, PE2 8JN","longitude":-0.2305068,"latitude":52.5631968}},{"type":"details","id":"f2b1a173-0611-4014-a980-894257b0bab0","attributes":{"display_property_style":null,"work_required":null,"heating_system":null,"council_tax_band":null,"council_tax_cost":null,"local_authority":null,"service_charge":null,"service_charge_period":"month","service_charge_notes":null,"ground_rent":null,"ground_rent_period":"month","ground_rent_review_period_years":null,"ground_rent_uplift":null,"ground_rent_expiry":null,"full_description":"<p>Here at Tortoise Property, we pride ourselves on doing things differently, by offering a complete partnership and consistent approach to construct a comprehensive marketing package tailored for the single purpose of selling your property as agreed at the initial valuation.<br><br>\"Tortoise provided me with a comprehensive property management service over a four year period, offering a friendly, transparent and consistent relationship.<br><br>When I decided to sell my property I immediately engaged with Tortoise to undertake the action. They actively advertised my property, were proactive with local sale opportunities and provided timely updates on progress. The sale on my property was agreed, exchanged and completed within five weeks. I would highly recommend Tortoise Property for their professional and friendly approach.\" - Tracey Matthews - Testimonial <br><br>Valuations<br><br>We concentrate on the maximum price your house is likely to sell for then agree a sensible timeframe for which the property should be sold whilst clearly explaining how the fee you are charged, is invested in enabling us to find your buyer from across the country.<br><br>\"I recently used Tortoise to sell my house, Chris came round and went through everything there price was better than all others I had received and they seemed a lot more genuine.\" - James Richards - Testimonial <br><br>Relationship management<br><br>Our relationship managers are here to personally look after you offering complete transparency and guidance throughout the sales process, following a 12-week programme that provides regular viewings with prompt feedback.<br><br>\"They say selling your home can be very stressful, not with this team, there was never a time you could not get in touch with these guys. You will be in safe hands all the way from start to finish.\" - Maxine Ambrose - Testimonial <br><br>Facebook<br><br>The growth of our sales portfolio into the wider Peterborough area we believe is the result of our unique strategy to capture maximum exposure. Facebook provides us with the opportunity to target our property marketing and expand our reach beyond the property portals.<br><br>Facebook live<br><br>The potential reach of a digital tour is limitless. Our live feed property tours on facebook are great for potential buyers to not only view the property but to ask relevant questions and get instant replies from wherever they are based.<br><br>Online and traditional auctions<br><br>Our property auction service gives you the ability to sell your property at auction either online or at a live auction. The buyer pays a commission so your house is sold at no cost to you. The buyer must complete within 28 or 56 days meaning your property is sold fast.<br><br>Performance-related fees<br><br>Here at Tortoise we do offer traditional fee structures based on a standard percentage of the purchase price or a fixed fee. However, we are so good at what we do that we are confident enough to offer you performance related fees we believe we should win together.<br><br>24\/7 services<br><br>Property sales can be daunting, especially if it is your first time. Here at Tortoise, we have real people available to talk to 24 hours a day 7 days a week as well as a live web chat so that you can chat to someone at your convenience.<br><br><br><br><br><br>Negotiator awards<br><br>In 2017 Tortoise Property was shortlisted for website of the year in the negotiator awards competing with large national estate agency chains illustrating the quality and presentation of our brand and level of service.<br><br>Our micro-site offers plenty of information so please choose from one of the tabs on the left that is applicable to your requirements and we look forward to seeing you in the near future or to find out more about us and our services visit www.tortoise property.co.uk<br><\/p>","short_description":null,"location_summary":null,"has_parking":null,"has_outdoor_space":null,"virtual_tour":null,"shared_ownership":false,"shared_ownership_notes":null,"shared_ownership_rent":null,"shared_ownership_rent_frequency":null,"shared_ownership_percentage_sold":null,"created_at":"2022-06-17T16:39:20+01:00","updated_at":"2022-06-17T16:45:16+01:00"}},{"type":"sales_listing","id":"be1cec3a-cf2f-40c4-a627-427cf3fbdfa7","attributes":{"status":"Sold STC","price":350000,"price_qualifier":"Fixed Price","display_price":true,"archived":false,"is_low_profile":false,"occupancy_status":1,"new_home":false,"created_at":"2022-07-19T11:38:08+01:00","updated_at":"2022-07-19T11:39:26+01:00"}},{"type":"media","id":"125542ce-27f1-4852-8fb6-b71daaaa70d1","attributes":{"name":"136511_31519016_IMG_00_0000","order":0,"is_featured":true,"feature_index":1,"title":null,"is_image":true,"url":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg","urls":{"thumbnail":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg?tr=pr-true,n-property_thumb","small":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg?tr=pr-true,n-property_small_fill_crop","medium":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg?tr=pr-true,n-property_medium_fill_crop","large":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg?tr=pr-true,n-property_large_fill_crop","hero":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg?tr=pr-true,n-property_hero","full":"https:\/\/ik.imagekit.io\/street\/street-mobile\/properties\/general\/844609\/136511_31519016_IMG_00_0000.jpeg"}}}],"meta":{"pagination":{"total":2,"count":2,"per_page":250,"current_page":1,"total_pages":1}},"links":{"self":"https:\/\/inventorymanchester.co.uk\/api\/property-feed\/sales\/search?page%5Bnumber%5D=1","first":"https:\/\/inventorymanchester.co.uk\/api\/property-feed\/sales\/search?page%5Bnumber%5D=1","last":"https:\/\/inventorymanchester.co.uk\/api\/property-feed\/sales\/search?page%5Bnumber%5D=1"}}
So the idea is we have "id" going into Pid, "inline_address" going into "inlineaddress" and so on. I don't need to store everything that's a part of the JSON string. Just parts that match the db columns if that makes sense.
Well, since you ALREADY have a nice parsing system of the data setup, and you ALREADY have a nice class object that represents the json which is now a great easy to use class object?
Then all we need and are asking here?
How can I insert a row of data into a table?
The above is YOUR ONLY question here.
So your code (warning - air code follows), will be somewhat like this:
string strSQL
= #"INSERT into [Tortoise_Street_Properties]
(Pid, InLineAddress) VALUES(#Pid, #Address)";
// replace TEST4 and properites with your conneciton string.
using (SqlConnection conn = new SqlConnection(Properties.Settings.Default.TEST4))
{
using (SqlCommand cmdSQL = new SqlCommand(strSQL, conn))
{
cmdSQL.Parameters.Add("#Pid", SqlDbType.NVarChar).Value = data.attributes.Pid;
cmdSQL.Parameters.Add("#Address", SqlDbType.NVarChar).Value = data.attributes.InLineAddress;
conn.Open();
cmdSQL.ExecuteNonQuery();
}
}
So, you simple outline the columns, setup the values from the object, and then insert the values.
We really don't care if you have 3 vars A, B, C, are reading a text file, or you have that complex json object.
Your goal, your question, your quest?
How can I insert some data into a database. That is the skill set and goal of yours.
edit:
The only issue is that some of the data is "repeating", and thus above simple insert code shows the field mapping and a simple insert of data into a table? You might have a outer loop - a for each on the particular data array. But, remember, you have a class type EVEN for those repeating data, and you want to use that class defined for the array.
You have STRONG typed data with that existing class, and you are now free to pull out data from the class with great ease. Simple find and get the data you want from that class, and use a simple SQL insert statement as per above.
Also, for creating say half a dozen little inserts? VERY little need to create a stored procedure for each routine - just code out the simple SQL and insert as per above. I would only write a gazillion little insert stored procedures if you need them in more then one place in your code. Writing a stored procedure for what amounts to a simple one line SQL insert is a formula for world poverties - it just not required.
The easiest method to bulk insert this might be to send the whole JSON string to SQL Server and parse it there using OPENJSON.
This is a somewhat complex JSON, as it has references in its properties to other properties.
Therefore it's probably best to first parse out the included array values into a table variable, then join it back to the main array.
It's unclear where you get virtualtour from, so I've left it out.
Note the data types, your current types leave what to be desired. latitude should not be an int, it should be a decimal, and price should not be varchar. The IDs appear to all be uniqueidentifier.
You don't need to specify a path if the property name is an exact match.
Nested arrays with more than one object must be parsed using a separate OUTER APPLY OPENJSON. In this instance you don't have any apart from included which we are parsing separately into a table variable.
CREATE OR ALTER PROC dbo.InsertJSON
#json nvarchar(max)
AS
SET NOCOUNT, XACT_ABORT ON;
DECLARE #included TABLE (id uniqueidentifier PRIMARY KEY, attributes nvarchar(max));
INSERT #included (id, attributes)
SELECT j.id, j.attributes
FROM OPENJSON(#json, '$.included')
WITH (
id uniqueidentifier,
attributes nvarchar(max) AS JSON -- for whole JSON object
) j;
INSERT dbo.Tortoise_Street_Properties
(Pid, inlineaddress, postcode, description, bedrooms, price, salestatus, brochure, longitude, latitude)
SELECT
main.PId,
main.inline_address,
main.postcode,
details.full_description,
main.bedrooms,
listing.price,
main.sale_status,
media.url,
addr.longitude,
addr.latitude
FROM OPENJSON(#json)
WITH (
Pid uniqueidentifier '$.id',
inline_address varchar(255) '$.attributes.inline_address',
postcode varchar(20) '$.attributes.postcode',
bedrooms int '$.attributes.bedrooms',
sale_status varchar(255) '$.attributes.sale_status',
address uniqueidentifier '$.relationships.address.data.id',
details uniqueidentifier '$.relationships.details.data.id',
salesListing uniqueidentifier '$.relationships.salesListing.data.id',
primaryImage uniqueidentifier '$.relationships.primaryImage.data.id'
) main
LEFT JOIN #included Iaddr ON Iaddr.id = main.address
OUTER APPLY OPENJSON(Iaddr.attributes)
WITH (
longitude decimal(9,6),
latitude decimal(9,6)
) addr
LEFT JOIN #included Idetails ON Idetails.id = main.details
OUTER APPLY OPENJSON(Idetails.attributes)
WITH (
full_description nvarchar(max)
) details
LEFT JOIN #included Ilisting ON Ilisting.id = main.salesListing
OUTER APPLY OPENJSON(Ilisting.attributes)
WITH (
price int
) listing
LEFT JOIN #included Imedia ON Imedia.id = main.primaryImage
OUTER APPLY OPENJSON(Imedia.attributes)
WITH (
url varchar(255)
) media
;
Your C# code should look like this
Use await wherever possible.
Pass parameters with the exact SqlDbType and precision/length.
...
if (response.IsSuccessStatusCode)
{
var properties = await response.Content.ReadAsStringAsync();
await InsertJSON(properties);
}
....
private static async Task InsertJSON(string json)
{
using (var conn = new SqlConnection(YourConnString))
using (var comm = new SqlCommand("dbo.InsertJSON", conn))
{
comm.CommandType = CommandType.StoredProcedure;
comm.Parameters.Add("#json", SqlDbType.NVarChar, -1).Value = json; // -1 means max
await conn.OpenAsync();
await comm.ExecuteNonQueryAsync();
}
}

How to limit the number of records saved in a day in ASP.Net Web Forms?

I am creating a patient booking system using ASP.NET.
I want to limit the number of bookings to 25 per day.
Using a suggestion, I have obtained the following SQL Trigger Code:
CREATE TRIGGER trg_CheckAppointmentCount ON dbo.schedule_master AFTER
INSERT,UPDATE
AS BEGIN
IF EXISTS (SELECT 1
FROM dbo.schedule_master YT
WHERE YT. Schedule_Date IN (SELECT i Schedule_Date FROM inserted)
GROUP BY YT. Schedule_Date
HAVING COUNT(YT.KeyColumn) > 25)
THROW 50012, N'Cannot have more than 25 appointments on a single day.', 16;
END;
GO
But I don't have a KeyColumn. Please suggest any changes.
This would better handled in the SQL Server side of things, in my opinion. you won't be able to do this with a CONSTRAINT but you could use a trigger. This is Pseudo-SQL, but perhaps something like this:
CREATE TRIGGER trg_CheckAppointmentCount ON dbo.YourTable
AFTER INSERT,UPDATE
AS BEGIN
IF EXISTS (SELECT 1
FROM dbo.YourTable YT
WHERE YT.DateColumn IN (SELECT i.DateColumn FROM inserted i)
GROUP BY YT.DateColumn
HAVING COUNT(YT.KeyColumn) > 25)
THROW 50012, N'Cannot have more than 25 appointments on a single day.', 16;
END;
GO
I wonder why would you limit the number of booking; However; this can be acheived just by a simple counter in your backend system. Perhasps some configuration of max record so that you can change it in future rather just limit it to 25. So get the total records created while new booking is getting created; and if it's > than config limit ( in this case 25) , just display a message back to the user.
Hope this helps you to build the logic.

SQL Repeative Event column and using the same in C#

Working on booking management application. It allows the user to book the appointment with the doctor. However, a doctor can also able to schedule their activity like Lunch Visiting Hours and Vocation.
Doctor can block activity as recurring based on frequency(daily/weekly/monthly) set in table
Referred How to design table structure for Google Calendar like Repeat feature?
For example
From 2-Aug-2013 to 31-Aug-2013 , Lunch hour is 2 P.M to 3 P.M
From 14-Aug-2013 to 16-Aug-2013 Vocation
From 2-Aug-2013 to 31-Aug-203 Visiting Hours is 10 A.M to 2 P.M
Also they can able to repeat the same activity for next month.
How do i create table structure for maintaining this data more efficiently.
Here is my approach
DoctorId Activity FromDateTime ToDateTime Frequency
What would the great way to store the frequency column format in Database in order to easily access in C# code to generate more number of same records for different dates based on weekly/monthly?
Assuming you want a table structure that allows users to book appointments with doctors (as opposed to helping doctors manage their schedules, as the question seems to imply both at various times), we don't want to design a table that tells users what the doctor is doing. A user should only be concerned with whether a doctor is available or not - why do they need to know the doctor is on vacation? Simply seeing the doctor doesn't have openings for a week or two should be enough. The below shows a simplified table structure of this: a reference table for the doctor's names, that where DoctorID would be the join to show the doctor's name and his/her available hours.
To solve the problem of a user booking an appointment, the user would see the doctors with available times and times would be arranged in a DATETIME format so that they could schedule at the appropriate hour with the doctor. If the doctor isn't available, a time wouldn't appear for them on a specific date (meaning that users select which block of time they want - as shown in the below simple example):
CREATE TABLE Doctor(
DoctorID INT,
DoctorName VARCHAR(250)
)
CREATE TABLE Appointment(
DoctorID INT,
AppointmentHour DATETIME,
Available BIT DEFAULT 1
)
INSERT INTO Doctor
VALUES (1,'John Doe')
, (2,'Jane Doe')
INSERT INTO Appointment (DoctorID, AppointmentHour)
VALUES (1,'2013-01-01 10:00:00.000')
, (1,'2013-01-01 11:00:00.000')
, (1, '2013-01-01 13:00:00.000')
, (1, '2013-01-01 14:00:00.000')
, (2, '2013-01-01 15:00:00.000')
SELECT d.DoctorName
, a.AppointmentHour
, a.Available
FROM Appointment a
INNER JOIN Doctor d ON a.DoctorID = d.DoctorID
DROP TABLE Doctor
DROP TABLE Appointment
SQLFiddle showing this example. On the other hand, if you want to build an application for doctors to set their own schedule, that could work in a similar way where doctors would enter the times they will be available and then, as shown in the simple structure above this, the user would see those available times only (when they select a time, the Available column turns to 0 - meaning it won't display in the C# application). For instance:
UPDATE Appointment
SET Available = 0
WHERE AppointmentHour = #UserSelection --OR: #DoctorVacation/#DoctorLunch/#DoctorOther
Would be an example of the SQL statement when a user selected a time (now, other users can't select it). For the doctors, there could be a default time, like 8 AM to 5 PM where a doctor is assumed to be available, unless they decided that they won't be (in which case, those times would be removed from the appointment table, or they could also be set to 0 so that they don't appear on the application, so that users can't select those times).

Records for Sales Person

I am designing this database and c# app, that a record gets saved to database. now say we have three Sales Person and each should be assigned a record in strict rotation so they get to work on equal amount of records.
What I have done so far was to create one table called Records and one SalesPerson, the Records would have salesperson id as foreign key and another column that would say which agent it is assigned to and will increment this column.
Do you think this is a good design, if not can you give any ideas?
To do this I would use the analytical functions ROW_NUMBER and NTILE (assuming your RDBMS supports them). This way you can allocate each available sales person a pseudo id incrementing upwards from 1, then randomly allocate each unassigned record one of these pseudo ids to assign them equally between sales people. Using pseudo ids rather than actual ids allows for the SalesPersonID field not being continuous. e.g.
-- CREATE SOME SAMPLE DATA
DECLARE #SalesPerson TABLE (SalesPersonID INT IDENTITY(1, 1) NOT NULL PRIMARY KEY, Name VARCHAR(50) NOT NULL, Active BIT NOT NULL)
DECLARE #Record TABLE (RecordID INT IDENTITY(1, 1) NOT NULL PRIMARY KEY, SalesPersonFK INT NULL, SomeOtherInfo VARCHAR(100))
INSERT #SalesPerson VALUES ('TEST1', 1), ('TEST2', 0), ('TEST3', 1), ('TEST4', 1);
INSERT #Record (SomeOtherInfo)
SELECT Name
FROM Sys.all_Objects
With this sample data the first step is to find the number of available sales people to allocate records to:
DECLARE #Count INT = (SELECT COUNT(*) FROM #SalesPerson WHERE Active = 1)
Next using CTEs to contain the window functions (as they can't be used in join clauses)
;WITH Records AS
( SELECT *,
NTILE(#Count) OVER(ORDER BY NEWID()) [PseudoSalesPersonID]
FROM #Record
WHERE SalesPersonFK IS NULL -- UNALLOCATED RECORDS
), SalesPeople AS
( SELECT SalesPersonID,
ROW_NUMBER() OVER (ORDER BY SalesPersonID) [RowNumber]
FROM #SalesPerson
WHERE Active = 1 -- ACTIVE SALES PEOPLE
)
Finally update the records CTE with the actual sales personID rather than a pseudo id
UPDATE Records
SET SalesPersonFK = SalesPeople.SalesPersonID
FROM Records
INNER JOIN SalesPeople
ON PseudoSalesPersonID = RowNumber
ALL COMBINED IN AN SQL FIDDLE
This is quite confusing as I suspect you're using the database term 'record' aswell as an object/entity 'Record'.
The simple concept of having a unique identifier in one table that also features as a foreign key in another table is fine though, yes. It avoids redundancy.
Basics of normalisation
Its mostly as DeeMac said. But if your Record is an object (i.e. it has all the work details or its a sale or a transaction) then you need to separate that table. Have a table Record with all the details to that particular object. Have another table `Salesman' with all the details about the Sales Person. (In a good design, you would only add particular business related attributes of the position in this table. All the personal detail will go in a different table)
Now for your problem, you can build two separate tables. One would be Record_Assignment where you will assign a Record to a Salesman. This table will hold all the active jobs. Another table will be Archived_Record_Assignment which will hold all the past jobs. You move all the completed jobs here.
For equal assignment of work, you said you want circular assignment. I am not sure if you want to spread work amongst all sales person available or only certain number. Usually assignments are given by team. Create a table (say table SalesTeam)with the Salesman ids of the sales persons you want to assign the jobs (add team id, if you have multiple teams working on their own assigned work areas or customers. That's usually the case). When you want to assign new job, query the Record_Assignment table for last record, get the Salesman id and assign the job to the next salesman in the SalesTeam table. The assignment will be done through business logic (coding).
I am not fully aware of your scenario. These are all my speculations so if you see something off according to your scenario, let me know.
Good Luck!

Implementing numeric pagination with asp.net

Hai guys,
I have nearly 20 pages in my website .... Every page has a gridview which has thousands of records bind to it... Now i want to implement custom pagination to all those grids.... Guys can some one give a pagination class which can be reusable for all those pages
Your not really going to get a one size fits all class to do this, thats why its called custom paging.
Just a rough guide as to how I have implemented this in the past.
Store the current page number somewhere Querystring/Session/Wherever
When you call your data method/stored procedure to ask for the data pass in the page number and amount of records per page you want.
ammend you stored procedure/data method to only return records in these bounds, it will also need to return a count of the total records so the application knows how many pages there are.
Here is simple example of how you could achieve paging in your stored procedures using SQL2005/2008 (Slightly more to it in 2000)
CREATE PROCEDURE GetTowns
(
#OutTotalRecCount INT OUTPUT,
#CurrentPage INT,
#PageSize INT
)
AS
SELECT * FROM
(
SELECT
ROW_NUMBER() OVER (ORDER BY TownName) AS Row,
TownId,
TownName
FROM Towns
) AS TownsWithRowNumbers
WHERE Row >= (#CurrentPage - 1) * #PageSize + 1 AND Row <= #CurrentPage*#PageSize
SELECT #OutTotalRecCount = COUNT(*) FROM Towns
Not sure about a "class", but here are a couple of links:
.NET 3.5
.NET 2.0
p.s. If you use DataSet as your DataSource, paging and sorting is supported out of the box.

Categories

Resources